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PREFACE 


The book is an elaboration of lectures given at The National 
University of Peking in the fall and winter of 1934-35. It is 
intended for students who have completed a course in Advanced 
Calculus, but have not as yet entered on the study of the Theory of 
Functions, either real or complex. Emphasis is laid on the new 
methods, and these are illustrated by many and varied applications, 
and numerous exercises. 

Chapter T deals with the convergence of infinite series. The 
student has hitherto been concerned chiefly with the results of 
limiting processes, the applications of the Calculus. As the next step 
he needs training in the more abstract use of simple limits as applied 
to problems of a purely analytic nature. He needs to live in this 
new domain of thought, in which the limiting process is the central 
idea. And he needs to work many simple problems, in which the 
existence of the limit is the chief end. 

Chapter 11. The Number System. The student has thus far 
taken the S 3 rstem of real numbers for granted, and worked with 
them. He may continue to do so to the end of his life without 
detriment to his mathematical thought. Thus he may omit this 
chapter altogether, taking the Theorem of Continuity, § 5, as a 
postulate, but noting, of course, the definitions and theorems of 
§§6,8,10. On the other hand, most mathematicians are curious, 
at one time or other in tlieir lives, to see how the system of real 
numbers can be evolved from the natural numbers. Dedekind’s answer 
is not the only one, or even the simplest one for the beginner; but 
it is one no mathematician can ignore and to which, probably, 
most mathematicians will give first place. 

With Chapter III, Point Sets, begin the new concepts which are 
fundamental in the Theory of Functions of Real Variables, and this 
chapter may form the starting point for the beginner, so far as any 
logical difficulties go. The concept; function^ is treated in §§ 3, 4, 
and now comes the definition of limits § 5. The proofs chosen for 
the Three Theore.ms on Continuous Functions may well be criticised. 
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Should not the writer pick out the method most easily accessible for 
the student (say, the method of nested intervals) and use that one 
method systematically? This is precisely what the student should 
do, usm ;4 these other proofs as exercises. Let me say right here 
that tlie only way in which the student can hope to attain mastery 
of tiie subject, is to write his own book. He should take each 
theore ri by itself, state it in his own language, and prove it as the 
author ou{!:lit to have proved it for tliat student’s needs. The clearer 
the presenialion in a text-book is, the w'orse for the student who 
would rt'ly on reading. The student must himself produce his own 
independent proofs of the main theorems, in writing, and then come 
back again and again to his own presentation, as he walks to a 
lecture or strolls through his favorite haunts in this enchanting city. 
First, the content of the theorem ; secondly, the method of proofs 
must go over into his flesh and blood. It is a question of habits of 
thought, and liabits arc formed by repetition. 

To ('o ne back to the three theorems on continuity, the student 
should ultimately dominate all the methods set forth. But it is enough 
at the beginning to have one method of proof for each theorem, and 
the choice is lelt to him. liCt it be said that no one can teach the 
student the 'llieory of lAmctions. For the Theory of Functions is a 
liabit of thought, not a set of rules to be applied like the formulas 
of differentiation. 

In saying these things we have really forecast the whole study 
of the uniform question. The difficulty with uniform continuity 
and the uniform convergence of series and integrals lies not so much 
in the definitions, and in the statement and proof of the theorems, 
as in recognizing a double-limit question when it arises in practice. 
For these questions are not labelled:—“Here is a double-limit.” 
It is on this account that especial pains have been taken both to 
illustrate the situation geometriccilly by graphs, and analytically to 
formulate the situation as a 

lim f lim s (/i, m) ] = lim [ lim s (n, m) ] 

n=seo rnanoo m—oo n^co 

question. It is with deep regret that the writer feels forced to treat 
systematically the double-limit questions for proper integrals. The 
student, after mastering Chapter V on Uniform Convergence of 
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Infinite Series, should find his own questions for the proper definite 
integral: 

J /(-r, a) dx, 

a 

and treat them independently. He can still do this, in the main, 
by reading only casually what is said in the text ol Chapter IX and 
then at once setting about his own individual elaboration of this 
whole subject. Even the case of improper integrals: 

oo 

^ f{x,a.)dx, 

C 

can be treated in like manner, and it is not till the question of the 
reversal of order of integration in the iterated improper integral 


oo oo 



a h 


arises, that he needs specific guidance. Here, again, however is an 
opportunity for independent thought. Let him do Chapter IX with 
a minimum amount of help from the book. 

But method is not the sole tojnc, nor should it appear to the 
student as an end in itself. His taste in analysis must be cultivated, 
and to this end, what better material than the elementary functions, 
developed out of their differential equations and leading to their 
expansion into series of fractions and infinite products; the F- and 
B-functions with their integrals and products, and a first suggestion 
of asymptotic expansions ; Fourier’s series and the develop nent problem, 
with an example of a divergent series, uniformly summable; Fourier’s 
integral, with applioations, and extension to functions of severtil 
variables; finally, differential equations, total and partial. 

This last subject has the wddest ramifications in pure and 
applied mathematics, and courses of the nature of rule of thumb are 
everywhere current. Two things the student needs to know in 
advance, namely: the intrinsic meaning of a diffemntial equation, and 
the existence theorems governing the solution in a restricted region. 
The proof of the latter affords opportunity lor expounding, on the 
hand of this important application, the greatest single method in all 
science — the Method of Successive Approximations. 
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The plan of publishing these Lectures was first suggested to me 
by my old friend and pupil, and present colleague at Peita, Professor 
Kiang Tsai-Han, who has accompanied their preparation with warm 
interest and generous support. 

It is a pleasure to express my deep appreciation of the efficient 
cooperation of the University Press, The National University of Peking, 
in this difficult task of mathematical composition. My former Assistant, 
Mr. Hsii Pao-lu, was most helpful in preparing the type-written copy 
for press. My present Assistant, Mr. Sun Shu-Peng, has been of 
inestimable service to me in seeing the book through the press. His 
keen interest in securing accuracy of detail, and his excellent 
common sense, have made him a most extraordinary helper in this 
undertaking. 

Peiping 

December 17, 1935 
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FUNCTIONS OF REAL VARIABLES 
Chapter I 

Convergfence of Infinite Series 

§ 1. Definitions. Let uq, ui, • • • be any set of nuniben 
proceeding according to a definite law. Form the sum: 

J/i = «o 4- Ml -f * • * + 

and allow n to increase without limit If Sn approaches a limit, denote 
the latter by U: 

Urn Sn = U* 

WsasOO 

The expression 

•1) Mo 4- Ml -f • * • 

is called an infinite series (or, more simply, a series). It is said to 
be convergent if Sn approaches a limit, U\ and this number U is 
assigned to it as its value. U is sometimes called the sMm, but this 
nomenclature is unfortunate, since it is impossible to add an infinite 
number of terms together. 

If Sn approaches no limit, the series is said to be divergent^ and 
no number is assigned to it as a value.* 

A familiar example of a convergent series is the geometric pro* 
gression 

2) a 4“ Mr + ar^ 4- • • •, 

where r is numerically less than unity. Here, 

... M-i M—Mr” 

5) Jn = M 4- Mr 4- * • • 4- Mr* ^ = — - - 

1—r 

and 

lim Sn — -7^. 
n-ssoQ 1 — r 

Hence 

♦) ar ■>r ar--ir'--, I r | < 1. 


• To certain divergent series values are attached through other convergent pro¬ 
cesses, some of which will be considered later. 
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A further example it the teriet 


JL + _L + _L +. 

1-2 ^ 2-3 ^ 3-4 ^ 


whose value it 1. Here, 




5n = 1 - 


lim fn = 1* 


•»n — •»* 

71 + 1 te* 

The early mathematicians thought that a series must converge if 
the general term approaches 0 as its limit: lim Un == 0. But this is 

72,^00 

not the case. As an example, consider the harmonic series^ 

6 ) 1+1 + 1 +.... 

It is possible to find n terms, the sum of which will exceed any 
given number, no matter how large. For, obviously, 


_!_ + _!_+. 
m -f 1 m 4- 2 


+ — 1 — >1 

m ^ 171 2 


since these terms (except the last) exceed respectively the terms 

— - -1-2-h • • • +- - — (to m terms), 

m-fm m + m + rn 


and the value of this sum is i. So we see that, striking in any¬ 
where in the series, we can add a definite number of terms which 
will yield a sum greater than J, auid hence Sn increases without limit 
as n increases. Thus the harmonic series diverges. 

TiihORiiM. A necessary condition for the convergence of an 
infinite series is, that the general term approach 0 as its limit. 

To deny the truth of the theorem is to assert that there exists a 
positive constant, h, such that, no matter how large m be chosen, 
there will always be a term, Up, for which 

\up\> h, p> m. 


But here is a contradiction. Mark off an interval about the point 


C7, extending from f/—€ to £/ + €. Since 
Sn approaches f/ as its limit, the points Sn 
will all remain within this interval when n 
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is greater than a suitably chosen integer, fn: 

U - ^ < s„ < U + IL^n. 

Here, € may be any positive quantity. Choose € — i //. I’iiere 
will be a term Up such that 

I 1 > ;> > 

Now, Sp^i lies in the interval (LT — c, £/ -h c). But, since 

Sp = Sp^i + Up , 

Sp lies outside the interval. Fro.ii this contradiction follows the truth 
of the theorem. 

Exkrcisks 

1. If the series 1) converges, show that the series 

7) Um 4- Unx+I 4- • • • 
converges, where m is any fixed integer. 

2. If the series 7) converges, show that the series 1) converges. 

3. If the series 1) converges, sliow that the series 

8) A* 7/0 4“ ^ 4- • • •, 

where k is any fixed number, converges. 

4. Is the converse of the theorem ol Question 3 true? Prove 
your answer to be correct. 

§2. Comparison Tests for Series of Positive Terms. 

Series whose terms are all positive or 0 can be tested for convergence 
by the following theorem. 

Direct Comparison Test for Convergence Let 
Mo 4- -f • • •, 0 ^ 

be a series of positive (or zero) terms to be tested for convergence. Let 
Mq 4" 4" * • •, 0 ~ M/i, 

be a series known to converge^ and let 

Un ^ an, mg n. 

Then the given series converges. 

Consider the sums: 

4- jq 4" • * • 4" 

= Mq 4* 4- • • • 4“ an^\> 
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If m = 0, *we have: 

Sft ^ 5 ||. 

Let be the value of the ^r-series. Then 


Hence 


Sn g /f. 
^ 


Thus we have in Sn a variable which always increases (or remains 
constant) as n increases, but which never exceeds a fixed number, A. 
Such a variable always approaches a limit, Z7, which in general is 
less than Ay but may, in particular, = A. 

The truth of this statement is plausible if we think of 5,, as rep¬ 
resented by a point on a line — the scale of numbers. For, these points 
move to the right — if they move at all—as U A 

n increases. But they never pass beyond ■ ■ i ■ ■ i I i 4 ' 
the point A, They must, therefore, con- 

dense on some point, (7, to the left of A, or possibly on A itself. 

An arithmetic proof of this basal principle will be given later. 
At present, we accept it as granted, and fonnulate it as a 

FijN’)\mf.ntal PnixcTpi.r. If Sn is a variable which always 
increases or remains the same as n increasesy but never exceeds 
some fixed numbery A: 

i) Sn « 

ii) Sn ^ Ay 


then Sn approaches a limity U: 

lim Sn = U. 

7I=» o 

Moreovery U ^ A. 

To complete the proof of the Test for Convergence it remains 
to remove the restriction that m = 0. For an unrestricted m, observe 
that 

+ * • • -f Wm-i + Urn + Mm+1 4* * ‘ + K/i-i , m < II. 

The variable 

Um 4- Mm+l + • • • + Um^k+1 


approaches a limit when k increases indefinitely, as has already been 
proved. But Sn differs from this variable merely by an additive con¬ 
stant. Hence Sn approaches a liinit, and the propf is complete. 
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We have made use of the fact that if each of two variables 
approaches a limit, their sum approaches a limit. The truth of this 
theorem is obvious geometrically. An arithmetic proof will be given 
latter. 

Example. Consider the series 




Compare its terms, beginning with the third, with those of the con- 
vergent geometric series, 



Since 

+ 1) > 2‘2-‘**2 (to n factors), 

it follows that 


1 

(n + 1)! 


< 


2w ’ 


and hence the given series converges, 

Dirfxt Comparison Thsp for Divergence. Let 


flo + + • • • ♦ 0 ^ an, m ^ n, 

be a divergent series^ and let 

an ^ Un, m = n. 

Then the series 

Wo -h “1 -i- 

diverges. 

The proof is left to the reader. 


Exercises 

Test the following series for convergence or divergence. 
1 1 

1. 1 + - + -+... 


2 . 


, 1 1 
^ + ■3 ■‘■T+' 


, I 1 

1 + 25 + 32 +- 


5. 
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4. 


5. 


6. 


ar 4- ar^ 4- r® 4- • • • 4- ar”* 4- * • •, 




0 g r. 
0 g r. 


4- 4- 

1 4- X® ^ 1 4- 1 


4- 


8. Prove the theorem:— Given the series 

Mo + 1^1 + • • •» 0 S u«, m ^ n. 

If n Un approaches a limit as n becomes infinite, and if this limit is 
positive, the series diverges. 

9. Show that the series 


TT3r+2+7 ■»•••• 

diverges for all values of x for which it is defined: 

— oo<x<4-oo, 1,— 2, •••. 

10. Given the series: 

Mo 4- Ml 4-, 0 S Mrt, m S n. 

If y^n approaches a limit as n becomes infinite, and if this limit 
is less than 1, the series converges: 

lim = y < 1. 

fiimmio 

But if y > 1, the series diverges. 

11. Given a power series: 

ao 4- aix + a 2 X® + • • •, 0 < m S n. 

Let 


lim ^ tfn = p > 0. 

Then the series converges for all values of x such that 0 s 2 ' < 1/p, 
What if ly an becomes infinite? 

12. (Kven a series: 

Mo + wi + • • • * 


0 < u». 


m S n. 
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If 


log—> y, m g ft. £ n, 
“n+1 

where *y is a positive constant, the series converges. 

§3. A General Test-Ratio Test. Let 

^0 + + * * * 1 0 < tfn, m ^ n, 

be a convergent series^ and let 

izo + Ml + • • •, 0 < W/i, m ^ Hy 

be a series to be tested for convergence. If 



M«4-1 


dn^\ 


Un 


> 

dn 

ike u-series 

converges. 



Proof. 

By hypothesis, 




Mm+l 

_^ 

Mm+1 


Mm 


dm ’ 


_ Mm+.‘> 

«< 

dm^i 


Mmfi 


f 

Mm+i 


Mm+* 

< 

dm-^k 


Mm+A—1 


am+k^l 

Multiply the k inequalities 

together. Thus 


Mm4-A 

_< 

dm-\-k 


Mm 


dm 


Un = 

Urn ^ 

- an^ 

dm 


The factor Um/dm is a constant. Hence the series whose general term 
is {um/d„^ an converges, and consequently the u-series converges. 

In the proof, we have made use of the theorem that if each of 
two variables approaches a Unlit, their product approaches a limit. 
The proof of this theorem wiU be given later. 

Divergence Test. Let 

dQ "h Ml * * ' 1 0 ^ M/i, nt ^ 
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ie a divergent series, and let 

Uq + Ml + •••, 0 < 

be a series to be tested for divergence. If 

^/t+1 •< 

an Un ' 

the U’series diverges. 

The proof is similar to the foregoing, and can be left to the 
reader. 

To illustrate these theorems, let the tf-series be the geometric 
series 

4* + ar^ + ***, 0<tf, 0<r<l. 

Then 


m s n. 


m ^ 71, 


an 


We are thus led to the familiar 
First Test-Ratio Test. If 

Wo 4- ‘ 


be a series whose terms from a definite point on are all positive^ 
and if 


lira <, 1 , 

«**•* an 

the series converges. But if r > i, the series diverges, r = 1, 
there is no test. 

For, we can choose r between r and unity, r < r < 1, or 
1 < r < r, and then the hypotheses of the general theorem will 
be fulfilled. 

If r = 1, the tt-series may converge and it may diverge, as is 
seen from the two examples: 

4 11 , , 

1 + ^ * (convergent) 



+ ••• 


(divergent) 
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Exercises 

1. Show that, if 

lim log——— = or, (0 < M„, m ^ n) 

the series converges when or > 0, and diverges when or < 0. 

2. Show that if 

1 § - ^"+1 , (0 < «„, m § n) 

Un 

the series diverges. 

§4 Cauchy’s Test by Integration. It happens in simple 
important cases that the function Un of the discrete variable n admits 
useful interpolation for a condnuous argument x. Thus 

111 

n ' nf' n log n ’ 

are interpolated by the continuous functions 

1 1 1 

x' x’’' xhgx' * 

Cauchy devised a simple method for determining the convergence 
of such series. 

Convergence Test. Let f{x) be a positive^ continuous, de¬ 
creasing, monotonic function, 

/(xO /U") SO. x' < x". 

Form the integral 

oe 

f f{x)dx. 

t 

If this integral converges, the series 

Mo + Ml H- 

converges. If the integral diverges, the series diverges. 

The proof follows immediately from inspection of the figure, 
p. 10. For obviously 

m+r oo 

= ff{x)dx^ ff{x)dx. 


Um^l -h M|»t+2 + • * * + Um^r 
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w+r 


When this last integral converges, the sum satisfies the hypotheses of 
the Fundamental Principle of 
%2^ A being the value of the 
integral, and so the series con¬ 
verges. 

On the other hand, O 

m+r 

J* f(x)dx £ “h + * * * 4“ Wm+r—1* 

m 

If, then, the integral diverges, the series diverges. 

Example, Consider the harmonic series, 

, 1 1 
1+-+-+- 



Here, 


fix) = 1/x, 


s 


dx 

X 


= log X — log m. 


Hence the integral in question diverges and the series diverges. 
On the other hand the series 

^ ^ < p> 

leads to the function \/x^ and to the integral 





The crucial integral is thus seen to converge, and so the series 
converges. 

Appraisal of the Error, Cauchy was much interested in 
appraising the error made in computing the value of a series, when 
one breaks off with the m-th term. Let 


= Ml + M2 + • • • == 5|| + Tn, 
r» == Mn+l + Mn+2 + • * *, 


A f(x)dx. 
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Tm s ^ S rm-l • 

But 

^m—1 Tut ~ Mm • 

Hence we obtain the following formula for the appraisal of the error: 

rm=‘ A ^ $Um, 0 < tf < 1. 

Thus 

U — Sm "¥ A OUfn f 

and we may stop adding terms as soon as we come to one which is 
less than the limit of error assigned. 

G>nsider, in particular, the series: 


li’ 

1 < 

' + 

{m+\y 

1 

(m-f 2/ 

- C dx __ 

_: 

J xf 

p— 1 


Thus the error made by breaking off with the m-th term: 

= i +^ + p+--- + -^. 

is given by the equation: 

_ 1 1 _ « 1 




- 1 4 . 1 4 . . 4 . 1 4 . _1 _ 1 _ 4 . J!_ 

'^2’'^ p-\ mf ' 

0 < Of < \, 

Let it be required to compute the value of this series for p 1.01 
correct to . Here the first term less than is 10”^. Hence 
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+ 


I 

gra* 


A has the value: 



1 

IQO-Ol 


= 97.72, 


and it remains to compute the sum . 


Exkrci ks 

1. Show that the exact computation of the term Um can be 
avoided by using the formula: 

^ + Bum, 0 < d < 1, 

where A has the same value as before, but B is different. Thus 
U = S/n—1 + ^ + BUm • 

2. Study the series 




+ ••• 


when /; = 1.001. How many terms must be taken, in order that 
the error made by dropping the remainder may be less than 1 ? How 
many, if the approximate formula for- the remainder be used? Com¬ 
pute the value of the series correct to the nearest integer. 

3. Show that the series 


2 log 2 

diverges. 

4. Show that the series 


5 log 3 


2(log2)'' 3 (log 3)/^ 


1 < P, 


converges. 

5. Treat the series 


^?ilogn(toglogn)^’ 


and generalize. 

6. Apply Cauchy^s test to the geometric series, 

« + or 4- tfr* 4* • • • t 0 < tf, 0 < r. 
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7. Prove the theorem:— Given the series; 

“o + “i + ■ ■ ■ > 0 S «n, m £ n. 

If liin rtf’ u„ = 0, i < p, 

the series converges. Here, /? is a constant. 

8. Show that the series 

converges for all values of x for which its terms are defined: 
“-co<j:<4-oo, X ^ -- i , —2^ —3^ • • * 

§5. Tests in Case lim Un+ilun = 1. When 


lin, = 1, 

naso U/i 


the First Test-Ratio Test fails. For example, if 

Jl^ nsao Un 

regardless of the value of p. Now, if p is very large, 101 say, 
the early terms of the series drop off rapidly. But the convergence 
of this series cannot be established by comparison with a geometric 
series, 


nP 


< nr". 


For, no matter how large a be taken, and no matter how near to 
unity r < 1 may be chosen, the inequality virill ultimately point the 
other way, since 

lim r* = 0. 

X^eo 

It is easy, however, to develop limit tests which will apply to 
series which converge or diverge commensurately with the series 


Here, 


an (n -H 1)^ 




14 


FUNCTIONS OF REAL VARIABLES 


where rn is of the order \/n\ 

Hence,* 

lim n (i —1 
V On J 

Consider now a series such that 

lim 71 f 1-=r p. 

First, let ^ > 1. Choose \ <, p < p. j p p 

Then, for large values of n, the variable ^ 

n(l--^) will be near 
and 

n f 1 — will be near o. 

Hence 

71 ( 1 — < 71 r 1 - 5^±1 \ m ^ n, 

and thus 

i^+l < TH ^ 71. 

M« an 

We see, then, that the n-series converges. Similarly, if ;? < 1, 
it appears that the iz-series diverges. We are thus led to the following 
Second Test-Ratio Test. Let 

Wo + *1-» 0 < Mn, 711 ^ n, 


• It is not necessary to base this result on the binomial series, or even Taylor’s 
Theorem with the Remainder (carried to the quadratic term). Write 


Now, the limit 


Um(i±^llr± 

X 


is ^wn at once by the Calculus to be —p, and we are through. 
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be a series such that 

lim /I ( 1 — j = A or + oo or — oo. 

V Uni 

If p > 1 or + oo, the series converges. If p < 1 or — 6b, 
series diverges, 7/ p = 1, there is no test. 

The test for divergence can be made somewhat sharper. For, if 



On the left stands the test-ratio of the harmonic series. Henoe the 
u-series diverges. 

Exercises 

In the following exercises, 

«o + Ml -h • • 

shall be a series whose terms ultimately become and remain positive. 
(It would do as well, of course, if the terms were ultimately to be¬ 
come and remain negative.) 

1. If 

lim r 71 — (n -h 1) = or or -f* oo or — oo, 

n=oo L Un J 

show that the series 

i) converges when or > 0 or -f oo; 

ii) diverges when <r < 0 or — oo. 

2. If 

lim n log -^^2- = or or -h oo or — oo, 

nsaeo Un^l 

show that the series 

i) converges when or > 0 or + oo; 

ii) diverges when or < 0 or — oo. 

3. If the test-ratio is of the form: 

ifn±l = 1 _ ± 
u„ n 
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where 

lim nr„ — 0, 

and c is a constant, show that the series will converge if c > 1 and 
diverge if c < 1. 

§6e Kummer’s Cntenon. One of the earliest attempts to 
obtain general criteria for convergence and divergence is found in a 
paper by Kummer^ of the year 1835. Let 

1) Wo + H-, 0 < m ^ n, 

be a series to be tested for convergence. Let Pm, Pm+i, • * * and a 
be any set of positive number. Form the expression: 

2 ) 

On writing this equation for n = m, m + 1, • * m -f r — I and 
adding, we find: 

5) Wm + «m+i + • • • + 0>m+r-i == 

Pm Urn _ Pm-i-r _ 

--- lim+i — Um+2 — * — 

a a 

Hence 

4) Mm+l + W/n+2 +••••+* M/n+r = 

Pm Urn __ Pm+r Wm+r _ __ _ _ __ _ 

-— Wm+i — — Ci>m+r-l* 

a a 

Lk.mM'V. If positive numbers Pm, a positive 

number a, can be found, such that con fe.O, m S n; i.e, if 

5 ) 0 g - (—+ 0m„«, 0 < «„, m m n, 

a \ a / 


then the u-series converges. 

For, from 4) we infer that 

. . ^ Pm Um 

Wm+l + * * • 4" Um^r ^ ^ » 

and since the right-hand member is constant, the theorem is proved. 
The condition 5) is equivalent to the following; 


6 ) 


0 < a 


^ Pn-^-- Pn+u 


" • Journal fur Matheinatik, vol. 13 (1835) p. 171. 
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This condition will surely be fulfilled whenever 


D ^ _ D 

^n+1 


approaches a limit and this limit is positive: 


lim f Pn-^ - P^I 1 = «r > 0, 

ne=*JC t 1 ■* 

For, it will then be possible to choose an a between 0 and o, and 
so, from a definite point in? ^ m on, we shall have 6) holding. 

We are thus led to the following test for convergence, which 
however, without any restrictive hypothesis relating to the signs of 
the terms, applies to any real series. 

Test for Convergence. Let 

“o + H- 

he any real series. If positive numbers Pmy Pm+i» • ’ • can be 
found such that the variable 


Un 


-Pn+l 


approaches a positive limit cr, or becomes positively infinite: 


7) lim \Pn— - Pn^\ I = O' > 0, or = -h CO, 

7j»ao L l/n+l J 

then the u-series converges. 

For it is obvious that must ultimately become and re‘ 

main positive, and so the series, from a definite point on, must have 
its terms all of the same sign. 

Test for Divergence. Let 

1^1 + + • • •, 0 < Uft, m ^ n, 

he a given series. Let Pm^ ^ ' he a set of positive numbers 

such that the series 


8 ) 



diverges. If the variable 


Pn^ 

Wn+l 
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approaches a negative limit cr or becomes negativ/dy infinite i 


9) lim IPn— - PtHi ] = «r < 0, or = - co, 

nanao *• Wfl+l ^ 

then the u-series diverges. 

Proof. From a definite point on, n ^ ^ /it, we shall 

have : 


Hence 


Un 




n+1 


< 0 . 



But the left-hand side is the test-ratio of a divergent series, 8). This 
proves the theorem. 

A sufficient condition for divergence is, that 


W|t *— -P^ 

provided the series 8) diverges. 

A set of useful choices for is the following: 

1. Pn = 1. This gives the First Test-Ratio Test. 

2. Pn = n. This gives the Second Test-Ratio Test. 

3. Pn = n log n. This given the Third Test-Ratio Test. etc. 


Exercises 


1. Assuming that the series 

yl, y 1—, 

^ n ^ n log n 


2 


1 

n log n log log n * 


etc. 


have been shown to be divergent by Cauchy’s test, § 4—or otherwise 
—apply the Second, Third, etc. Tests for Convergence and Divergence 
to tlie series 


_ 1 _ 

71 log n (log log ny ’ 

§ 7* Contimiatioiu Discussion. Given any convergent series 
1), it is always possible to find a set of positive PnS and a positive 
a such that «hi ^ 0. For 3) is equivalent tx« the relation 


2 ^' 2 


n(logn)^’ 
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Pm^r Mm+r ^ Pm Um 
— a (cOni + + * * * + CD/n+r—1 

+ Wm+i 4“ Zim-f2 4- • * • 4" 

If, then, co„ ^ 0 is the general term of a convergent series, a > 0 
can then be so chosen that the right-hand side of the equation will 
always be positive, and Pm+r can then be determined from this equa* 
tion (Pm > 0, arbitrary at the start). 

Moreover, the Pn and a can be so deteimined that 


Pn-^ 

will approach any positive limits 


P n+l 

cr. For, let 


<»5n — 

and determine the Pn accordingly. Then 2) gives 


Pn-^- Pn+l = 2 a, 

W/l-J-l 

and it is sufficient to set 2^z = or. 

Secondly, given any divergent series 1), a set of fiositive ran 
be found such that the series 

Pn 

diverges and the variable 




Pn - Pn^i 


approaches an arbitrary negative limit, (T. 

In fact, we need only determine the PnS from the relation: 


Pn-^ 

fhi+i 


-Pn^i 


(T < 0. 


Here, 

/^W+I //«+! = Pn Un + (cr) * 

From this equation follows; 

Pm^r Urn+r Pm d" 4" ' ’ * 4" llm+r)* 

Thus a set of positive PnS is determined. Will the series 
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diverge? It will. For, strike in anywhere and add terms; 


1 + 1 1 


Let 

Then 


A ^ Pm (t) («m+i + * * * -f ^i). 


1 




P|i+* + (-<r)(iz,i+i-f •••+^x+;fc) 


—1—I- —\—j-^ —3!— 

^lA+2 


_ -f* ^tA-f-2 • • * -h mH-P __ 

A •+• (“Cr) (Ujjufi + Mji+o +***•+• 

By taking p large enough we can bring this last fraction as neair to 
l/(—cr) as we please, and so, in particular, make 

1 s _i_ ..... ^ 

^ IM-l •Pi *+2 2 (— cr) 

Hence the series 2 l/Pn diverges, and this completes the proof. 

To sum up, then: An arbitrary series, 0 < rn = n. can 
be proved convergent by tVie Convergenco Test, or divergent by the 
Divergeni'e Test, if the P„’s be suitably chosen. 

Tliirdly, tor the divergence test, it is not enough to demand 
inerelv ihn^ a set of positive P„’s can be found such that 


Pn 


Mn+l 




n+l 


approaches a negative limit. For, if the w-series be a convergent 
series of postive terms and we determine Pn s as in the last case, 
these PnS will all be positive. But the series S l/Pn will now 
converge. 

§& Alternating Series. Theorem. The series 

Wo — Ml + -, 0 ^ Mn, m ^ n, 

converges if 

1) *^n4*i S m ^ n\ 

ii) lim Mn = 0. 

Iia»j0 
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Proof. Form the sums; 

^2n = (Wq — Ml) + • • * + ~ 

‘^2n4-l = Mo — (mi — lio) - (m2«-1 ““ Mo„). 


Observe that, since 

1) ^2n4-l ~ ^2 m "h Mon, 

2 ) . 


u 

< ■ I < ! ■ " >■' 

So 52 54 55 S3 S2 


Now, So„ steadily increases with n, or remains constant; and s^n ' 1 
steadily decreases with n, or remains constant. It follows, then, that 


5) S.2„ S Sj. 

Consequently, by the Fundamental Principle of §2, approaches a 
limit: 

lim .So,, = 17,. 

n —30 

Similarly, approaches a limit: 

lim 52„+2 =172. 

Waaao 


Finally, because of i) and ii), these two limits are equal: 

a, = U 2 . 

Consequently Sn approaches this common limit, U: 

Urn s„ =s U, 

and thus the theorem is proved. 

The Error. Since Sni 'vith inc reasing n, continually jumps over 
its limit U (or (X)incicles with it), w'e see that the error due to 
breakings the series off at any point, does not exceed numerically the 
value of the first term in the remainder. 


Examples: 


a) 

b) 

c) 


, I t 

2! 3! 


V 3 1 5 


1 




2 log 2 3 log 3 4 log 4 
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d) _1_1—+... 

log log 4 log log 5 

How many terms of the first series are needed to obtiin the valuef 
correct to A? how many of the last? 

§9. Series with Positive and Nesrative Terms at Plea¬ 
sure. Ijet 

1) Mo 4 Ml H- 

be any series whatever. Set 

(Tm ^ 4 t^o 4 * * • 4 t’mt 
Tp Wi 4 M/o 4 • * • 4 Wp, 

where • • • denote the positive terms, taken in order as they 

come, and where the negative terms are — mi, — m^o, * • • . Then 


fin = Wo 4 Ml 4 ^ 
can be written in the form: 


4 M„«, 


where, in particular, if no positive terms have appeai’ed, we agree to 
write (To = 0; and similarly for ro. 

As n increases, the series 
5) Vj 4 4 * • * 

4) M'l 4 1^24 • • • 

may converge or they may diverge — it is not necessary to think of 
the case of a finite number of positive or negative terms as an ex¬ 
ception, for any sum may be regarded as an infinite series, all of 

whose later terms are 0, Thus if 1) is the series 

5) 

both the series 3) and 4) diverge; but 5) (xinverges by § 8. It is 
clear, however, that if both the series 3) and 4) converge, the vari¬ 
able Sn will approach a limit because of 2), and so the series 1) 

will converge. We are thus led to the 

Tiikohicm. a sufficient comlition for the convergence of a 


Wq 4 M^4 * * * 
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is the convergence of the series of absolute values : 

7) I -h 1 I + • • • 

Proof, Let 

•S’n = I “o I + I “l I + • • * + I Un^i 1- 

I'hen 

*S'/i = CT/n + Tp. 

Let A be the value of 7). Then 

= Ay Tp ^ Ay 

and hence, by § 2, both the series 3) and 4) converge. 

A series 1) whose absolute value series converges is said to con¬ 
verge absoluteljTy or be absolutely convergent. Other convergent 
series are called conditionally convergent. In the case of these latter 
series, both the series 3) and 4) diverge. It will be shown later 
that the terms of an absolutely convergent series may be rearranged 
at pleaisure without changing the value of the series. But if the 
series converges conditionally, a new series can be constructed from 
its terms, which will converge toward any preassigned value what¬ 
ever, or diverge toward or diverge toward — cx); Chap. VII, §2. 

Test-Ratio Test. If the series 

Mo + “1 H- 1 Un ^ Oy m ^ n, 

be giveUy and if its test-ratio Wn-fi / “/i approaches a limit ; 

lim = r, 

/laaooo Un 

then the series 

i) convergesy if 1 r 1 < 1; 

ii) divergeSy if 1 r I > 1. 

Proof, If I r I < 1, the series of absolute values converges. For, 

_ I I ^ 
l^n I Mn I ’ 

and the left-hand side of this equation approaches a limit, namely, 

1 »• I- 

If, on the other hand, I r | > 1, it follows that Un does not 
approach 0 as its limit. For, from the proof in § 5, \an\ does not 
approach 0. 
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The more refined test-ratio tests of § 5 help in establishing the 
absolute convergence of a series, but are useless if the series converges 
conditionally. 

Finally, we observe that it is sufficient for convergence to de¬ 
mand that 


Un 


< y < 1, 


m ^ 


where y is a constant; i.e. not to impose the restriction that a limit 
exists. But the limit form is the one that is useful in practice, and 
for that reason should be given first place. 

Comparison Test, Let 


Mo -b “i H- 

be a series to be tested for convergence^ and let 

Mo + Ml H-, an 0, m ^ n, 

be an absolutely convergent series. If Un/an approaches a limit: 


Uin 

Tiaroo an 


existSy 


then the u-series converges absolutely. 

For, since Un/cin approaches a limit, it follows that ] Un 
must also appinach a limit. Denote the latter limit by 
choose U > L. Then, from a definite point on. 


Z>, and 


I 




< Lf, 


f. ^ n. 


Hence 


\un \ < V\an\. 


The series whose general term is this laist expression converges, and 
this fact yields the proof. 

Divkk(;i:n(;i: Tt.sx. Let 

Mo -b Ml + • • • 

be a series to be tested^ and let 

«o -b -b • •0 < M», m g n, 

be a divergent series. If Un/an approaches a limit not 0: 


lim = I, 0, 

!,» Un 

then the u-series diverges. 
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Test the following series for convergence: 


1-2 1-2-3 1-2-3-4 

y‘^ ido® ^ ^ 


100^ 


100 * 


2. 

2100 5100 4100 

2 2^ 2“ 


3. 

3 52 33 

5* ^ io» 15» 


4. 

i- 4. JLl2 . 1-2-5 

3 3-5^ 3-5-f ^ 


5. 

J. . t-3 1-3-5 . ... 

2 2-4 ^ 2-4-6 ^ 


6 . 

ijY* my* mi 

)’- 

7. 

ay* 

)*- 

8 . 

cos X cos 5x cos 5x 

1 3'‘ ^ 5- 



9. 

10 . 


1 4- 2x -f 4“ 4jr* 4-' 

a? 


11 ^ + _i 

2 2-^ 2» 


12 . 

13. 

14. 


4- -= -■ 

V 3 


1 

1/7 


1 


l/a 4- T'^a 4- 2r 
log (1 4- r) 4- log (1 + r^) 4- log (1 + r^) 4- 


4- 


1 




< a. 


0 g r. 
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15. log (1 + y) + log (1 + •^) + log (1 + Y) ■* ^ 

16 . log (i - y) + (^ “ ia) (‘ ~ p)+■■■• 

§ 10. Infinite Products. Let y*o» yii • • • be any set of numbers 

proceeding according to a definite law. Form the prodxict 

Pn =fo-fl ■■■ /«-!■ 

If */i, arid the variable 

Pm, r ^ fm‘fm-^\ .Z^+r-i 

approaches a limit different from 0: 

lim Pm, r=^ Pm ^ 0. 

y*M oo 

then the infinite prodiuct 

fo-fx ••• 

is said to converge and the number 

P = lim p„ 

rtxastxi 

is assigned to it as its value-. 

P^fxxfxfr-- 

For example, the infinite product 

L5,2>4.5-5 .. 

2-2'3-3 * 4*4 ’' 

converges, since the product 

^ _l-3 2-4^ , + 

2-2 33 V rr J 2 r 

approaches a limit different from 0, and so 

-1 1-5.2 4.3»5 ... 

2 2-2’3-5’4*4 

On the other hand, the infinite product 

J. 1..1 

23*4*’ 

diverges. For here 
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_±. .jfL _ r „ t 

2 3 ’ r+1 r+1 

approaches the limit 0. 

These hi^h handed definitions are surprising. Their justifica¬ 
tion lies in the demands of practice. There are no infinite products 
with an infinite number of vanishing factors in any known domain 
of mathematics. To admit such for consideration would complicate 
the tlieory —cui bono? — Again, to admit as con\’ergent an infinite 
product whicli vanishes without any one of its lactor’s vanishing 
would break with the analogy^ with the products of ordinary algebra, 
For these reasons, and others, we have thrown such infinite products 
into the discard of divergent products. 

From the definition of convergence follows immediately that the 
factors of a convergent infinite product ultimately become and remain 
positive. 

Tm.oiu.M. A necessary and sufficient condition for the con- 
vergence of an infinite product: 

lies in the convergence of the infinite series: 

log/m + log/m +1 + • • 

where m is suitably chosen, 

a) The condition is necessary. Hypothesis; the product con*^ 
verges, or 

Pm, r ^ fmfm-^i * ’ ’ ’ fm+r 1 

approaches a limit not 0; moreover, m may and shall be so taken 
that fn > 0, m ^ n. Conclusion; the series converges. Proof; let 

Sr = ^Ogfm + logyin+i ‘F ’ * * “h log • 

Then 

V = logy^?m, r- 

Since pm, r approaches a limit Pm > 0, and since log jr is a con¬ 
tinuous function, it follows that log pm, r approaches a limit, find 
hence the series converges. We observe in passing that 

log Pm = log/m + log/,«+i H- 

b) The condition is sufficient. Hypothesis; the series converges; 
i.e. lim Sf exists. Conclusion: the product converges. Since 
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Pm, T = 

and since ^ is a continuous function, it follows that approaches 
a limit: 

lim , 

where 

Sm = lo^ym + logyirH-l + * * * • 

Finally, this limit cannot be 0 because the exponential function is 
positive for all values of the argument. 

Corollary. A necessary condition for the convergence of an 
infinite product is, that 

lim/„ = 1. 

n=»30 

For this reason it is often convenient to set 

fn = 1 "h 

Thus the infinite product appears in the form: 

(1 + (1 + « i )* • • 

Convergence Test. A sufficient condition for the convergence 
of the infinite product 

(1 + «o) + ^i)* • • 

is the absolute convergence of the series: 

flo + + • • • • 

We may omit any factors in which an = 0, since such influence 
the convergence of neither the product nor the series. 

Consider the series: 

log(l 4- Uq) 4- log(l + tfi)4- • • • 

Apply the Comparison Test of § 9. Since 

Hm + A 

x^O X 

exists, it follows that log(l 4- Uf^/Un approaches a limit as n becomes 
infinite, and so the series of logarithms converges. Hence the infinite 
product converges. 

It is not true that the mere convergence of the a-series vriU 
insure the convergence of the product For example, the product 
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' ■/T'' ' ' •/T'' 

is easily seen to diverge by use of the series of logarithms. But the 
series 

-4= + -L_ 

V 2 i/T 

converges. Nevertheless, if the a^s be restricted not to change sign 
we can obtain a divergence test. 

Divergence Test. // 

^0 “h + * • * 

is a divergent series whose terms from a definite point on are all 
of one sign^ the infinite product 

(1 + ^o)(l + ^i)’ • 

diverges. 

The notation for an infinite product is: 

iiu 

n =»0 

ExERcisr.s 

Test the following infinite products for convergence. 





50 


FUNCTIONS OF REAL VARTABIJES 


7. Study the Binomial Series: 

^ . . m (m — l) o . 

1 + mx + —+ * • *, 

determining its convergence in all cases. 

8. Show that the infinite product 



(1 + r)n + (c - ab) \ ^ ^ 

(a + n) (6 + n) / ’ 


•1, ~2. -3, 


diverges toward 4- oo when r <C — 1; converges, when r = — 1; and 
diverges toward 0 when — 1 < r. 

§11* The Hypersfeometric Series i 


F(a b c x)-i t X 
F{a,b,c,x)-l+ ^ ^ c(c + 1)1-2 


This series includes some of the important elementary functions) 
but it also defines a class of more general functions, which arise not 
infrequently in practice and whose properties have been studied by 
means of the theory of functions of a complex variable. 

Some simple specializations of the series are the following, 

(1 + xT =sF{-n, b, b, - x); 
log (1 + x) =s xF(.l, 1, 2, — x)i 


We propose to discuss the convergence of the series in all cases, 
First of all, we must impose the restriction: c ^ 0, — 1, —2, • • *, 
foir otherwise no series is defined. 

Next, when either n or ^ is 0, —1, —2, •• •, the series breaks 
off with a finite number of terms, thus reducing to a polynomial, 
and so, considered as an infinite series, converges for all values of x. 
There remain, then, the cases: 

a, b, c ^ 0, —1, —2, • • • 

For what values of x ^ 0 will the series converge? 
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The general term is easily formulated: 

a (a 4“ !)♦ • - (fl -I- n -- \)b{b !)• 


Thus 


c(c -f 1) (c + /I ~ 1) 1-2 


'{b -f n — 1) 




Uj,+i _ (a n){b ^ n) 

Un (c -f w) (1 + n) 

Its limit is and so the series converges absolutely in the interval 


-1 < jr < 1, 

and diverges outside this interval. 

There are still two points in doubt, namely = + 1, — 1, for 
each of which the test-ratio |w„ 4 .i|/|w„| approaches the limit 1. 

The Point x — 1. Here, we can use the Second Test-Ratio 

Test in Rummer’s form, § 6. Since 

Un _ {c 4- n) (1 n) 

Un+i ia 4- + n) 

we have: 


n 


Un 


- 4- II =r -h l)rfc ~ g - - ah] 

//n+i {a. 4- /?) (^ -f /i) 


and thus o’ is seen to have the value: 

(T ’Tz c — a ^ b. 

Henc^ if 

0 •< c a the series converges; 

c — a — b < 0, the series diverges. 

When c — — /> ™ 0, the test fails, and we proceed to the next 

test. Here, 

fi \ncr rt —^-n 4- 1 log n 4- I = 


<" + ’’ i»f!" - i»s ” +' ] - 

+1) [iog(,. +1) - iog~ + .) ] 

The limit of this variable is seen to be —1, and cx>nsequently the 
series diverges. 
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To sum up, then: In the case jp = + 1 we have 

i) Convergence, when 0 < c — tf *— A; 

ii) Divergence, when c — a — A g 0. 

The Point x = — 1. Here 


Um^\ _ _ {a -f n) (A 4- n) 

Un (c + n) (1 + /l) ’ 

and the series ultimately becomes an alternating series. When 
0 < c — n — A, 


the series converges absolutely. When 


we have: 


where 

Let 


c — n — A g 0, 

1 ^ 1 1 _ j _ (1 + r)n + (c - ab) 
|un| (c + n) (1 + n) 

r = c — A^O, 


Then 


(1 -f r)n 4- (c —ab) 
(c -h n) (1 + n) 


^ ' -(1 + + flmfl)* * ’(1 “h 


The infinite product 


11(1 4 - dn) 

n^m 

diverges toward -f oo when r < — 1, and consequently Un does not 
approach 0 as its limit; the n*series diverges. 

When r = — 1, the infinite product converges, and again the 
u-series diverges, for the same reason as before. 

But when r > — 1, the infinite product diverges toward 0. 
We have: 

I) <1. (. s». 

ii) lim = 0. 

Qmsequently the u-series converges conditionally. 
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To sum up, then:— When ;r = — 1, we have 

i) Absolute Convergence, when 0 < c — « — 

ii) Conditional Convergence, when — l<c — a — = 

ill) Divergence, when c — — —1. 

The student sliould supplement his work on this chapter with a 

fresh and airelul study of the chapter on Infinite Series in the 
Author's Introduction to the Calculus (Chap. XIV) and also with a 
renewed study of the ch.ipter on Indeterminate Forms in the 
Advanced Calcidus (Chap. X.) 



Chapter II 

The Number System 

§1. The Problem. We take the natural numbers 1, 2, 3,* • 
lor granted. W^e think of them as collections of individuals, like a 
bag ot marbles; but we define them as marks^ like 1, 2, etc. 
I'he representation of such a number by means of a base, as; 

347 = 3 X 102 + 4 X 10 + 7^ 

is not a part of the rx>ncept, number. 

We assume the idea of addition as known, whereby out of the 
two numbers, a and a third is formed: 

c ^ a b. 

W'e think of two bags of marbles emptied into a third bag. 
Furthermore, we define subtraction as solving the equation: 

4* X = when a <, b^ 

and write: 

X ^ b a. 

Multiplication we also take for granted. By ab we mean the 
number b added a times: 

= ••• + ^ {a times) 

Divison consists in solving the equation 

ax = b^ 

when b is a multiple of a. 

It will also be (onvenient to point out that both subtraction and 
division, when possible, are unique; and furthermore to adjoin the 
theorem (proved by Euclid’s algorithm of the greatest common divi¬ 
sor) that a natural number can be represented in one and (except 
for the order) but one way as the product of its prime factors: 



A corallary of this theorem should also be noted:— If a and b 
are relatively prime to each other, and if ac is divisible by b^ then 
c is divisible by b. 
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Inequality. "We also assume as known what is meant hy a 
it > by and point out that 

i) a <. by then b "> a, and conversely; 

ii) ii a <. bt b <. c, then a < c; 

iii) i{^ a <. b and c <. dy then a c < -f 

iv) it** a <. h and c <. dy then ac < bd; 

v) ii a <. by then na > by for a suitable n. 

The Formal Laws of Algebra. For the numbers and the pro¬ 
cesses above considered the following laws hold without exception: 

I. A B = B + Ay Commutative JL^vv tor Addition; 

II. A + (B-\-C) = {A■^B)'\-Cy Associative I^w for Addition; 

III. A B — B Ay Commutative Law for Multiplication; 

IV. A{B C) — {A B)Cy Associative Law for Multiplication; 

V. A {B + C) = A B A Cy Distributive Law. 

By an algebraic equation is meant an equation of the tonnrf 

H- V an ^ by 

where the coefficients are any numbers of the particular domain in 
question. 

This equation includes the equation 

1) a A X = by 

whicii v\'e met in defining subtraction; and also 

2) ax — by 

appearing in division. 

We now proceed to extend the number system so that Equation 
2) will always admit a solution. 

The Concept: Number. What is a “number"? We have been 
so used to the numbers 1, 2, 3, 4, • • • from earliest childhood, that 
we take them for granted; and also the simpler fractions, like I , J , } . 

* If fl ^ & and c dy where at least one of the upper signs holds, then 
a A c < b + d. 

•* If a ^ ^ and c ^ dy where at least one of the upper signs holds, then 
nc < bd. 

4 Later, when the number system has been enlarged to include the number 
0, we shall set 0 and require that oo ^ 0. 
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*» 

But what is ? The answer lies in the concept of a class 

of objects, or as it is sometimes technically called: a logical class. 
The whole numbers are a case in point; for, any two numbers, a 
and 3, of this class are either equal or unequal. And for the objects 
of this class we have two processes — addition and multiplication, 
whereby respectively any two objects, a and b, determine a third 
c(= a + b or = ab). 

Now, we proceed to enlarge this class — or, better, to define a 
more comprehensive class, containing the whole numbers as a sub¬ 
class — our object being to provide ourselves with a number system, 
i.e. a logical class, in which addition and multiplication are defined, 
such that, whatever numl)ers a and b may be in the new system, 
division is always possible; i.e. Equation 2) always has a solution. 
§2. Fractions. G>nsider the logical class, or set of elements, 

(m,n), 

where m, n are any natural numbers. The element is the mark 
(m, 7i) itself, and we will speak of it as a number and refer to it 
by a single letter, as 

A = (tfi, fla), B = {bi.b^), X = etc. 

Equality. Two numbers, A = (^i, B = (^i, b^) shall be 
said to be equals when 

aib^ = 

We write 

A=:^B. 


It follows from tlie definition that if 


then 
and if 
then 


A^B 

B^A\ 

A^B, B^C, 
A^C. 


If ^ = (m, n), then does A also = (X m, X n), where X is any 
natural number; and also, in case m and n are both divisible by X: 
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Let X be so chosen that 


X ’ ‘ X 

are prime to each other. Then 

A=^{m\nf) 

is said to be in reduced^ or no rmal ^ 

If JB = (^ 1 , ^ 2 ) is number which is equal to A, 
A = B, 

then hi = lu m', h 2 = it rd, 

where p. is a natural number. 

Inequality. We say that 


when 


ifn,n) < (m', nO, 
mn^ < m'/i. 


Relations i)—v), § 1, are then seen to hold in the present system. 

Addition.^ By the first cotnbination {erste Ferkniipfung) we 
mean the following. If A^ (^i,/lo)* ^ 

A 0 5 = (ai^2 + 

(Read: ^^A with B”.) A “combination” is essentially a function of 
two variables: f{A^B\ having properties which result fmm the 
specific definition. 

The ComnmUitive and the Associative I^iw follow at once: 


l. = 

II. A ® \ B ® C \ ^\ A ® B \ ® C. 

Multiplication. By the second combination we mean: 

A @ 5 = (fli bi, ao b^). 

It is also commutative and associative: 

m. A ® B = B (S> A, 

IV. A ® \ B ® C \ A ® B \ ® C. 
Finally, the Distributive Law holds: 

V. A®\B®C\^\A®B\®\A®C\. 
Proof, by direct computation. 


* It would be better to consider first multiplication, as being simpler. But such 
an order it lew in harmony with the procedure in the later cates. 
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Division, We are now in a position to prove that division is 
always possible and unique. Given the equation: 

1) A ® 
to solve for X = (xj, x^. 

Here, we have as a necessary and sufficient condition: 

2 ) aih2Xx Oo bi X2> 


Obviously, one solution of 2) is: 


Xi = Oo ^ 1 , 

Let 

xi = Xx [, 


Xo = hy 

Xo = X j:2 , 


where x[ , X 2 prime to each other. And now the number X = {x'i,X2) 
is seen to be a solution of 1), and the only one, any two numbers 
that are equal being regarded as identh al. For the most genenil 
solution of 2) is = ft x(, ^2 ~ f** -^ 2 » 2) is both necessary and 

sufficient. 

Idemfactor. There exists a number /= (1,1) such that 
I ®A = A, A ® A, 

where A is any number of the system; and only one such number. 

The Natural Numbers as a Sub-Class. Within the present 
class of numbers there is a sub-class which can be identified with 
the natural numbers. If we associate the number (a, 1) with a: 

(a, 1) -—' a, 

then the firs^t and second combinations %vill also correspond respectively 
to addition and multiplication. For, if 

(a,\) © (^^,l) = (c, 1) 

then a + ^ = c; 

and if 

{a. 1) 59 {b, 1) = (c, 1), 

then ab = c. 

We can, themfore, replace the number (a, 1) by a in all com 
putations, and furthermore write, as a matter of notation: 
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Thus the present class reduces to the natural numbers and the posi¬ 
tive fractions. 

The “first combination” and the “second combination”, together 
wkh the notation 0 and 0, have now served their purpose of set¬ 
ting forth precisely in what “addition” and “multiplication” consist 
as applied to fractions. We may, there lore, henceforth discard them, 
and write •+- and X as signs lor the processes we have so carefully 
defined; e.g. 

A , - 175 + 192 _ 367 

12 35 420 420 ’ 

A X ^ - 80 _± 

12 35 420 21 ‘ 

Between any two numbers, a and {a <. b) of the present 
system there lies a number of the system. For, the number 

_ a b 

has the property that 

a <. c < b. 

Hence there is an infinite set of numbers lying between a and b. 

There is no least number. For, if a be any number, then \a 
also is a number, and \ a <. a. 

By the distance between a and where a < />, shall be meant 
the number b — a. 

If a be any number of the system, then there are numbers 
larger than a and arbitrarily near a\ and also numbers less than a 
and arbitrarily near a. F'or, let € be chosen arbitrarily small and, 
in particular, let € < a. Then the number — € is less than a 
and distant only € from a. And, similarly, a -b € > a and distant 
only € from a. 

Finally, if « be a number of the system, however small; and G, 
a number, however large, then a natural number m can be found 
such that 

ma > G. 



For, let 
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(both taken, for definiteness, in reduced form). Then the inequali^ 
we wish to establish is, that 


9 Q 

By definition, this inequality holds if 

mpQ > gP, 


Here pQ and qP are natural numbers, and an m can always be 
found to satisfy this condition — e.g. m = 7 P + 1. 

§3. Negrative Numbers. Consider a new logical class, or 
class of elements, {a, />), where a, b are fractions.* Two of these 
numbers,, (fl, Z>) and shall be said to be equalt 

(a,b) = ia\bf), 
if 

a b' = + b. 

It follows that 

(fl + X, 2? + X) = (<2, 2>), 


where X is any fraction; and also 

(n-X, Z.-X) = («,£.), 


so far as both a — X and ^ — X have a meaning. Moreover, these 
are obviously the only numbers equal to {a^b). 

An arbitrary number of the system can evidently be reduced to 
one or the other of the forms {a, 1 ), 

Inequality. By definition: 

{a,b) < {a\b^) 

if a + 6' < a' + 


Addition. The first combination shall be defined as follows. If 
A = ^ ~ (^i» ^2)1 then 

A B ^ {ai - 4 " ^1, an + ^o)* 


• The component clemeuts, a, etc. might equally well be natural num¬ 
bers; i.e. we can introduce the negative whole numbers in this way before 
proceeding to fractions. On the other hand, we might postpone the intro¬ 
duction of the negative numbers till the positive irrationals had been defined, 
and then a, b. etc. would be positive irrationals. — The notation ( ) has, of 
course, nothing to do with the ( ) of § 2, which has now been discarded. Let 
the student replace it by [ ], writing [a, ^], etc., if this form it more agree¬ 
able to him. 




THE NUMBER SYSTEM 


41 


'fhe Q>n:iniutative Law, 
and the Associative I^iw: 

A®\B^C\ = \A®B\®C, 

are seen to hold. 

Subtraction, Let it be i*equired to solve the equation: 

A®X ^ B, 

Let X = (xj, X 2 ). Then 

{ai + xi, a2 + Xo) = (Z>i, ^^ 2 )* 

Hence 

Ui 4* Xj[ + ^ ~ ^2 "i" -^2 “h 

and so 

Xi = ^2 4” 

X 2 — 4“ ^2 

These equations are both necessary and sufficient. Hence sub¬ 
traction — defined as the inverse of addition — is always possible and 
unique. The difference, X, is denoted as follows: 

X^BQA. 

The Number 0. The number 

^0 == («»«) 

has the property that 

Ao^A^A, A@Ao = A, 

where A is any number of the system. It is denoted by 0, or {a, a) = 0. 

The number A^, called the negative of A, is defined by the 
equation: 

^ 0 ^/ = 0 . 

If = (fl, bl then Af = {b, a). 

Furthermore, 

Af ^OQ A. 

It thus becomes natural to attach to the sign 0 a new meaning, 
defining Q A diS the negative of A, Observe that the sign Q is now 
used in two senses — once, as a functional symbol in a function of 
two variables. 


J{A,B)^BeAli 
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and again as a functional symbol in a function of one variable. 

This explains the meaning of — in ordinary algebra.* It is 
the negative, of a\ the number which, when added to a will 
give 0. But a may be positive, negative, or 0 , and — a is not neces¬ 
sarily a negative number. 

The equation 

A®X 

can be solved conveniently by means ol .4', the negative of A. For, 
a necessary condition for X is, that 

Af ® A® X ^ Af 

Hence 

0 © X = © B, 

or X = B®Af, 

Conversely, this condition is sufficient. 

The Law of Signs, To avoid the ambiguity in the use of the 
sign ©, replace © in the second sense by ©'. Thus if A^ is the 
negative of A^ we will write: 

Af = 0 ' A, 

Observe that 

& A) A; ^ © (©' 5) ^ 0 B; --f © (©' JB) = ^ © B, 

We find by direct computation that 

0'U©5) = 0 '^©( 0 'B) = 0 '^©B, 
e'U©B) = 0 '^©B; 

0' i&A®B)=^AQB; 

0' (0'^©B) = ^©5. 

These identities justify the ordinary rules for the use of the 
minus sign in Algebra. They show clearly the two meaning*: of that 
sign in such transformations as 

— (a — 6 + c) = - a + fc -c. 

Here, the first term on the right, —is the negative, a', of a. The 
last minus sign is capable of two interpretations: 

e In the lines that follow, our references to ordinary algebra are purely 
for illustrative purposes. The systematic connection with ordinary algebra 
win be made at the close of the paragnqpb. 
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i) it may be the 0 of 

(— a -h 6) 0 c; 

ii) it may be the 0' oi the negative of c, c' = 0/c; the plus 
sign being omitted: 

+^)0(0 'c)= + 

Multiplication, The second combination is defined as follows. 
If A = and B = (Z>i,^ 2 )» t^l^en 

“4” ^2 ^2 “b 

It is at once obvious that the Commutative Law holds: 

A ^B = B ^A. 

’The Associative Lavv,< 

A® B®C\^ \ A® B ®C\ 
is also true. For, co npute the left-hand side; it is: 

Cj *4* a^ Z>2 ^2 “b a2 l^x Co -4* ^2 ^2 

Z>i Co 4- ai Cl 4- hi Cj + c^. 

Next, observe that, on the right, 

i ^ i @ c = C 0 ! J? @ ^ 

It is, therefore, enough to note that the above expression is unchanged 
when the a's and the c’s are interchanged. 

Finally, the Distributive Law, 

A ® \ B ® C \ ^ \ A ® B \ ® ] A ® C \ , 

is shown to hold by direct computation. 

The Tdemfactor. The number 

/ = (a + L fl) 

has the property that 

A® I ^ A, I® A = A. 

It will be shown presently that it is the only number that has 
this property for all A\s, and thit even for a particular ^ 0 it is 
unique. 

This number is, for multiplication, what 0 is for addition: 
A®0=-0^A=-A, 

Divison. l^et it be required to solve the equation 
A®X^B, 
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If y/ = (fit,/I 2 ) be any number ^ 0; i.e. ^ then there 
exists H number such that 

A% ^ or A* ® A [. 

We wish, namely, to solve the equation: 

(«i, ^ 2 ) 0 (^i» ^ 2 ) = (^ + 1, X), 
where X is arbitrary. Thus 

ai xx 4- ^2^2 = X -f 1, 

^2 ”f" X. 


Hence either i): 


(a^ ^ 2 ) ■*’1 — X (flj — iio) + ^1 


= 

V (flf — flf|) Xo = 


V {a\ — flf|) Xo = X (/ii — flo) ““ ^*2 
if > /I 2 and X is so chosen that 

X (fix — ^ 2 ) > ^ 2 - 
Or ii): if ai < ^ 2 , then 

/ (fl| — of) = X (^2 - «i) — 


==' 

^ {a\ — a^) — 


^ {ai — a\) (^2 — «i) 4 - «2 

X being so chosen that 

X (iZo — £ii) > ai. 

When, however, aj = % = c, the equations reduce to 
fca:i-fcj :2 = X + l 
V CO?! + c j:2 = X. 

These equations never admit a solution. 

Returning, now, to the equation 

A A" = B, 

assume that ^ 0. Then a necessary condition for X is, that 
or / 0 X = ^' 0 B 


X^Bi^AK 


Conversely, this condition is sufficient. 

Thus division is always possible when A ^ 0, Moreover, it is 
unique. In particular, then, / i.s unique. 
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Finally, U the product of two numbers is 0, then one of the 
factors is 0. For, if = 0, A ^ 0, then X = 0. 

Relation to the Fractions. I’he present number system contains 
a sub-class of numbers, namely, the numbers (/r + 1, 1), which, 
together with the four species, are holoedrically isomorphic with the 
fractions. By this we mean that if we relate 

A {a I, 1) with a, 

and so 

B -b 1, 1) with b\ 

then 

A@B = {a^h + 2,2) 
will correspond to a b and 

^ @ -b 1, 1) 

will correspond Xa ab. Moreover, if 

A < B, then a < b. 

Thus the numbers (a -b I, 1) of this sub-class obey precisely the 
same laws of combination (equality, inequality, the four species) as 
do the fractions, § 2, and we may, then, write interchangeably 
(a -b I, 1) and a, @ and + , ® and X, etc. 

The remaining numbers of the class, except 0, are the so-called 
“negatives” (see above) of these. For, any such number can be 
written in the form; 

^ = ( 1 , 1 ), 

and its negative, A^, is: 

Af = 0/ ^ = (a -b 1, 1) = 

or 

^ = 0 / - a. 

Observe that we are herewith defining — fl. The number 0 is its 
own negative; —0=0. 

The numters (a, b) for which a^b are called positive numbers \ 
those for which a <.b^ negative numbers. The number 0 is neither 
positive nor negative. 

The numbers of our present system reduce, then, to the fractions, 
a = p/q^ of § 2, which we shall henceforth refer to as the positive 
fractions^ their negatives, — a = — p/q^ which we shall call the 
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negative /rac/ions; and 0. I’liis number system is called the ^stem 
of the commensurable or rational numbers. 

The absolute value of a positive number or zero is defined as 
the number itseh : 

\ A \ A ii A ^ (fl, b) and a b. 

The absolute value of a negative number is its negative: 

1 . / 1 — A^ = (^, a\ if A = {a^b) and a <. b. 

Inequalities, The relations of inequality, § 1, i), ii), iii), hold 
in the present number system; but iv) and v) lapse. Instead of vi) 
we have, however: 

( il a <b and c > 0, then ac < bc\ 
iv') < 

(. if a < b and c < 0, then ac > be. 

§4. Irrational Numbers. The Cut. A nong the numbers 
thus far considered — the positive and negative fractions — there is 
no number that can solve the equation: 

= 2 . 

For suppose x m/n were a root. Then 


or 

Ttv" =-* 2 /r. 

Here is a contradirtion. For, each prijne factor of the left-hand 
side appe<irs an even number of times, but on the ritjht, 2 appears 
an odd nuuiber of times. 

If we consider an arbitrary [jositive fraction, its square is either 
less than 2 or greater'than 2. In the first case, we put it into the 
class ol numbers whose elements we denote by ai\ in the second 
case we put it into the class of numbers whose elements we denote 
by ^£.>. 'rims we have a partition of all the positive fractions into 
two classes, and each is less than any r/o *. 

a\ ^ a*>. 

Such a partition Dedekind called a cut. More generally, let any 
criterion be given whereby the oomuiensurable numbers fall into two 
cLtsses, an arbitrary number of the first class being less than any 



THE NUMBER SYSTEM 


47 


miniber tfo second class. For example, every fraction, has 

the property that any other fraction is either less than a, and so 
belongs in the class of the Cj, or is greater than a, and so belongs 
in the class of the a^. The number a itself may be assigned to 
either class. But the class of cuts is more comprehensive than 
the class of the commensurable numbers. There will be in general 
no largest a\ nor smallest a^. 

Dedekind considered the logical class consisting of all cuts. This 
is the class of the irrational numbers. Let the mark 

(fll, tfo) 

refer to such a cut. It — the mark — shall be called a number, and 
it may also be denoted by a single letter, as 

A = {ax, a^)^ 

Here, the mark A is the number. 

Equality and Inequality. Two numbers, A = {ax,an) and B = 
{biyh^, are defined as equal\ 

A^B, 

if ai = ^2» 

no matter how ax, 02 , bx, ^2 b© chosen from their respective classes. 
At most one of the lower signs can hold. 

We say, 

A <. B or B > A 

if it be possible to find a particular bx^b[ and a particular 02 = 
such that 

a2 < bx. 

Rational Numbers. Those numbers (^ 1 , 02 ) which there is 
a largest ax (call it a) or a smallest ^2 (^^^1 'hall be identified 

with the rational numbers: 

Those numbers {ax,a 2 ) for which some ax is positive are called 
positive numbers', those for which an ^ is negative, negative numbers. 
The number (—< 12 , — ^i) is the negative of {ax,a^, and is writ¬ 
ten — {ax, a^. The number 0 is neither positive nor negative. 

By the absolute value of {ax, ao) is meant the number itself, 
when it is positive or 0; its negative, when {ax, 02 ) < 0. It is 
denoted by the symbol: 

I 1 = 1 {ax, 02 ) 1. 
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§ S« The Theorem of Continuity* The present number 
system has the property which Dedekind characterized as continuity. 
It is embodied in the following 

Thkorkm. Let ••• be a set of numbers such that 

i) ^ » 

ii) Sn ^ A. 

Then there exists a number U such that 

a) s„ ^ U, 71 = 1, 2 , - • •; 

b) y < Sn, m ^ n, 

where y is any number less than U: 

y < U, 

and rn is a corresponding integer. 

•Proof. Let be a fraction exceeded by some Sn (and so by all 
later ones). Consider the totality of such fractions. Let a^ be any 
one of the remaining fractions. Then the number 

U = a^ 

has the properties a) and b). For, first, if V did not satisfy Condi¬ 
tion a), there would be a number 

Sjif ^ U, 

and between Snf and f/, a fraction c; 

U < c < s„,. 

Because c < 5 ,,/, c is an . This is impossible because every 
ai ^ U. 

Setx)ndly, if Condition b) is not fulfilled, then 

Sn ^ y 

for all values of n. Choose a fraction, c, between y and U: 

y < c < U. 

Then Sn < c, and hence c is an Uu This is impossible because 
every flo ^ The proof is now complete. 

Decimal Fractions. Ijet M be any integer — positive, negative, 
or 0— and let ai^a^, * • * (0 S S 9) be any set of whole num¬ 
bers proceeding aax>rding to a definite law. Then the mark 

M. ^2 ’' ’» 
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which is 


understood as an abbreviation 




lor the mark: 
-H •••, 


is know as a decimal fraction. Thus 3.1415926 is a decimal 
fraction. If we set 







and identify this niunber with the Sn of Dedekiiid's Theorem, the 
value of the decimal is defined as the corresponding^ number, V. 

Conversely, to an arbitrary number A corresponds a decimal 
fraction whose value is A. For, let i\/ be the largest intejjer which 
is less than A. Choose «] so that 




A ^ M + 


a\ 4- 1 
10 


and so on. 


§ 6. Convergence. Limits. The Fundamental Theorem.* 

By the neighborhood of a point A = (aj, a^) are meant the numbers 


yi < a: < yo, 

where yi <. A and yo > ‘''^re arbitrary. By the ^-neighborhood of 

A is meant the neighborhood, where € is a positive fraction and 


yi = (^1 — €, rto — €), yn = («! + €, + c). 


I jet Ml, A/o, • • • be a succession ot jx)int sets** having the follow¬ 
ing property. To a positive fraction € cliosen at pleasure there 
corresponds an integer m and a point of Mm such that the 


• It may seem an error of judgment, in thi*se l^ec*tiires, to introduce at 
this point a theorem wliich, in the scit‘iitiJic deveh^pmeiit of the student, 
clearly belongs in the ciiapter on Point Sets. Stdl, scientific })erspective may 
on occasion become more important than the priiu'iples of I)edagogy, and the 
fact that this theorem is more fumluneiital than even tlie lour Species for 
irrational numbers entitles it to rank tl^ese processes. Tlu* beginner will do 
well to read this theorem and its proof with an opeti mind, but not. at this 
Stage, to give it more thought than his imagination readily supplies. He can 
come back to it after finishing the cha})ter on Point Sets, but he should think 
of its place in the science as here, rather than later. 

*♦ cf. Chap. Ill, §1. It is merely the conception or defirdtion of a point 
set witli which we are here concerned. 
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€-neighborhood of 5m cxjntains th? set A/n, if ^ m. The point 
sets Mn are then said to converge as ti -- 

Theorem 1. Let Mi, • • he a convergent serfuence of point 
sets. Then there exists a number V such that an arbitrar y ^'neigh¬ 
bor hood of IJ contains all the later Mn {a ^ m). 

Proof, Let Ui be a fraction that is exceeded by some point of 
Mn for all values of n Irom a definite jxiint on; i. e. lor n'^m, 
where m depends on ai. Consider the totality of such fractions a\. 
Let be any frac;tion not an ai. Then the ai, a<^ define a cut: 

This number U has the properties of the V of the theorem. For, 
let c' be a positive fraction < J €, and let ft, 5a be the numbers m, 
5m corresponding to c' by the hypothesis of converi^ence. Then M,i 
lies in the €'-neighborhood of 5'a when n ^ [Jl. Rut the points of 
this neighborhood lie in the €-neighborhood of U. For if it extended 
above the-latter, there would he fractions ai "> U; and if it extended 
below the latter, there would be fractions /Zo 

Definition of a Limit. The number U is defined as the limit 
of the numbers x constituting as n becomes infinite. 

Till OKI M 2. Let Ml, Mo, • • • he a convergent ^sequence of point 
sets, and let Ni, -Vo, • • • be a second sequence, the points of Nn 
being all contained in Mn. Then the second sequence converges and 
has the same limit as the first. 

In the foregoing definitions and theorems the point sets Mn have 
been made to depend on a single integer, n. It is obvious that they 
may equally well de[x?nd on variables whicli in a more genenil sense 
approach limits; cf. the definition of Function in Chap. Ill, § 3. It 
is enough for our present purposes to consider a single extension, 
namely, to an aggregate of point sets A/«y, where n and q are natural 
numbers, and where the earlier condition m^ n is now replaced by 
the pair : m = /i, I ^ q. 

§?• Addition of Irrationals* The sum* of two numbers, 
A = (ai,a 2 ) and B = {bi,b. 2 ), shall be defined as the number C = 
(Cj, Co): 


• We now drop tlie expression “first combination”, meaning by “sum” 
the some thing. 
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where 


or 


Cj — Co = flo + ^2» 

{^l» <^2) ~ (^1 “h flo "h ^2). 


It is understood that each ai is combined with each bi to yield the 
Cl *, and siniilarl}: for C 2 . 

To justiiy this definition observe first that 


since 


Cl 


C 2 , 


(l\ ^ ^ 2 * ^ ^ 2 * 


Secondly, to an arbitrary positive fraction, €, theie correspond 
a c\ and a C 2 such that 


(*2 < Ci 4- € . 

For, to an arbitrary c' > 0 there correspond the relations: 

^2 ^ 1 “H €» hij, <C, ^ “h €, 

Hence 

aa 4 - ^2 < «i' + *1 + 2 

and it remains only to set 

€' = i € , Cj = -f , r 2 = ^2 + ^2 • 

b'lnally, the Cj, C 2 exhaust all the fractions with possibly one exception. 

Addition obeys the Commutative Law: 

I. A B ^ B A; 

and also the Associative Law: 

IL .4 4 - 4 - C) = U + fi) + C. 

It is obvious tliat 

A 0 - A, 0 A = A, 
wliere A is any number. 

Subtraction. The inverse 3f addition is subtraction. The pro- 
blem is to solve the equation: 

A 
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Consider first the case B = 0. It is obvious that one solution is: 
Af = (— —^i)- 

Thus 

^ -h /f' = 0. 

Ijet be an arbitrary solution: 

A ^ A" = 0. 

Then 

A' ^ AA" = A\ 

and since 

A' + A ^0, 

it I’ollows that 

. 4 " = Af. 

Hence A^ is unique. 

Proceeding now to the general case we find as a necessary con¬ 
dition : 

A^ A JC A^ + -B, 


X^B + Af. 

Thus X can be no other number; and we see that, conversely, this 
number is a solution. Hence subtraction is always possible and 
unique. 

Observe the inequalities: 

i) \A + B\ S \A\ + \Bl 

ii) If |.•/| - iBlil S \A + B\. 

iii) If \A - X \ ^ H, 

then A-H^X^A + H, 

and conversely. 

§8. Limit of the Sum of Two Variables. Let Afi, Afo,* • 
and iVo, ••• be two convergent sequences of point sets. Let X 
be a point of Mn and Y a point of Nn- Form the sequence of 
point sets P 2 » ’**» where Pn consists of the points X + F. 
Then Pn converges^ and 

lim Pn = lim Mn + Ijtn A/ii, 

n^so nsiseo 

or 

lim (y + r) == lim X + lim Y. 
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We wish to show that, to an arbitrary* € > 0, there cor* 
ies|X)nds an rn such that 

U7 + r-x- r| < €, m g n, 

where X and Y are points of A/n» M,, and m ^ fi. 

We know that, to any c' > 0, there corresponds an m such that 

\rj-x\<i\ |r-r|<€'. 

where X, Y are points of iV„, and m ^ /«. Hence 

|r/+ x~ n < 2 

If, then, we choose c' = ^ €, the proof is complete. 

We could equally well have defined an aj^gre^ate of point sets 
Pn(f made up of the points X of and Y of ATy, and shown in a 
similar manner that 

lim Pm/ = lina Mn + lira . 

W-co //-assx) 

§9. Multiplication of Irrationals* The product of two real 
numbers, A =- (ai, a^) and B = {bi, shall be defined as follows. 
I iCt fractions be chosen at pleasure: 


€1 


€2 

s * 

*» 

liiU €„ = 0 ; 

n==oo 



12 

^ . 

* *, 

lim rjn = 0 . 


n=oo 


I^t Up (;? = 1, 2) be any point of the €„-neighborhood of Ay §6, 
and let bp (^r = 1, 2) be any point of the q„-neighborhood of J5. 
I^t \ X \ ■= Mn consist of the points 

X = Op bq. 

Then these points approach a limit, 

U == (m], M 2 ), 

as n becomes infinite. This number is defined as the product of A 
and B : 

U=ABy 

(<*i, (^ 1 , h) = \ 


• Now that addition has been defined it is obviously henceforth immateriiil 
whether we require e to be a positive fraction or an arbitrary positive 
number. , 
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For, Jpt aphq lie in Mm and let bqt^ lie in any Afn, 
m ^ and so, also, in Mm* 

Since 

I apt ap I ^ 2 I biff — | < 2 fjm » 

it follows that 

apf == ap Cu 1 Cl I < 2 €m, 

bqf = bq -i- C2* I C2 1 < ' 2 fjm* 

Hence 

apf biff -- aphq = bq -f- C2 + Ci C2* 

Now, there is a constant G such that 

< G, \bq\ < G 

for any ap, hq under consideration. Consequently 

1 ap biff apbq\ < (r (2 Cm + 2 qm) + 4 €m •Jm* 

If, now, a positive fraction c be chosen at pleasure, m can be so 
determined that 

G (2 €fn “f* 2 fjin) + 4 €m ^ €. 

Consequently the €-neighborhood of a point { of Mm — namely, 
5 ^-apbq — contains all the points of each later Mn (m < n) and 
so the sequence of point sets Mn converges. 

Idemf actor. There is one number of the system, namely : 

I — (^ii ^ 2 )’ = 1 ^ a^, 

which has the property that 

lA^AI^ A, 

where A is any number of the system; and I is unique, as will 
appear from the uniqueness of division. I is the number 1. 

The truth of the Commutative Laws 
I. AB-BA, 

is obvious from the definition. The Associative Law. 
n. {AB)C=^A{BC), 

is also true. For, let fractions 

Xw ^ X„+i, lim = 0, 

be chosen arbitrarily, and let Cr (r = 1, 2) be a point of the X»* 
neighborhood of C ~ (cx, c^. Let consist of the points 
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X ^ Op bq Cr • 

'Fhen il is shown exactly as before that these points x approach a 
limit, 

— lim { Up hq Cr i . 

n~-3o 

This number, V, has the value UC, where U — AB. For, the 
definition of the latter product is as follows. Let U = (ui^ Uy)- liCt 
fractions 

f^n ^ fJL„ = 0, 

n-=oo 

be chosen, and let t/-r, (ir = 1 , 2 ) be a fraction lying in the p.n- 
neighborhood of U. Let as before, lie in the X„-neighborhood 

of C, Then shall consist of the points u^Cr, and 

U C = lim ! Uw fr ! . 

n~oo 

Since the points ap hq for a given n include all the fractions 
l 3 ring in a certain neighborhood of the point U ^ A B, it is clear 
that the can be so chosen that the fjtn"neighborhood of U will 
include only such fractions as are contained among the above 

ap bq. When this is done, the points of the set j Cr ! for a given 
n are all contained among the points of the set \ apbqCr \ correspond¬ 
ing to the same n. Thus the \ u^Cr] are sub sets of the \ ap bq Cr |« 
and hence, by Theorem 2 of § 6 , their limits are equal, or: 

UC = {AB) C. 

On the other hand, F is invariant of the order of the factors, 
bq, Cr* Hence 

F = {B O A, 

and since the commutative law holds, 

F==A{BC). 

Thus the Associative Law is established. 

Division is the inverse of multiplication and is expressed by the 
equation: 

AX = A ^ 0, 

First, let B ^ I, the idemfactor, 7=1; 

= 1. 
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One solution of this equation is the following. Tjet a set of fractions 
be chosen: 

ei S €2 ^ liwt «n = 0 , 

and let €] < \ 4 \. Let J = (aj, and let be the points 
!/«;. (F = 2) where ap lies in the €„-neighborhood of A, Then 

the sequence of point sets Mo, • • * converges. For, let alf 

be any two points of M'^, and let G be a positive fraction < | .4 1 — c^. 
Then 

1 1 _ aq — ap 

iip it q itp (tq 

and hence 

J:_L — ' ^ J ^ ^ 

ap aq 1 Opalj 1 

Denote the limit by : 

AA^ =r = 1. 

It is called the reciprocal of A^ and is unique. P'or if 

= 1 , 

then A^A = A\ 

or A^* = A^. 

Turning now to the general equation, 

AX^B, 

multiply by A^: 

A’AX^ A' 

X = BA^. 

Thus division is always possible when 4 ^ 0. Moreover, it is 
unique. For, if 

AX==AY, 

then A'AX-A'AY, 

and so X = T. 

Multiplication has been defined and the foregoing properties have 
been established, independently of addition — in fact, the whole treat¬ 
ment could precede addition. We turn now to the last of the five 
formal laws, which combines both addition and multiplifafion. 
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The Distributive Law: 

A{B + C) = + AC. 

Here, if ^ B = h,), and C = (q, Co), the left-hand 

side is, by definition: 

A{B -h C) = lim { Up {btf + Cq) !• 

On the right, 

A B = lim j Up b(f j, AC ^ lim i apt Cqr j. 

/2s=s30 TV=eo 

By the theorem of § 7 and Theorem 2, § 6 the first of these 
three limits is equal to the sum of the last two, and this proves the 
theorem. Thus the five formal laws of algebra hold for irrationals. 

The System of Real Numbers. By this is meant the class of 
numbers defined above as cuts, plus the four species defined for these 
numbers. This number system has the property that a product 
vanishes when and only when one of the factors vanishes. 

§ 10. Roots* Inequalities* From the definition ol a number 
as a cut follows at once that the equation 

x" == , 0 ^ fl, 

admits one and only one positive root (or 0 ): 

X = jy a . 

For, let ^2 ^ 2 my positive fraction such that 
a < 

and let be any other fraction. Then 

X = (fli, a.,) 

is a solution of the equation, and the only solution which is not 
negative. 

Inequalities. Any two numbers of the system of real numbers 
are equal or unequal, and if a <. b^ then b ^ a. Moreover, if 
a <. b and b <. c, then a <, c. Between any two numbers, a <. b., 
lies a number, c: a <. c <. b. Also, if 0 < a and 0 < there 
is a natural number n such that na > b. 

The student will find it convenient to have firmly in mind the 
further relations:— 
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i) 

If a < 

b and c ^ dy then a + c < b d. 

ii) 

If 0 g 

a < b and 0 S 

c < dy then ac < bd. 

iii) 

If a < 

^ ka < kby if 0 < A:; 
by then < 

V ka > kby if A < 0. 

iv) 

If 0 S 

a <, by then 




^ a < \/^ and 

v) 


1 a + i-| ^ 1 

a 1 + 1 |. 

Vi) 


1! 

g \a + b\. 

vii) 

If la- 

.r 1 ^ hy then 

a — h 

^ a + k. 


and conversely. 

§11. Retrospect. Starting with the natural numbers and the 
four species, we proceeded to the positive fractions, and thence to the 
negative fractions, thus obtaining the system of rational numbers. 

From this point we introduced the irrational numbers by means 
of the cut. The definitions of equality and inequality, and of addi' 
tion, were most natural and simple. Even before addition was de¬ 
fined, it was possible to for.iiul ite and prove the fundamental theorem 
concerning limits, and thus the basis for all analysis occupies the 
first place in the development of arithmetic. Multiplication derives 
its definition from this principle. 

On the other hand one might reasonably seek to create the 
number system first. Addition is defined naturally by means of the 
definition of number as a cut; 

(flj, Co) + bo) = (^1 "h ^2 "b ^ 2 )* 

One would like to define multiplication in the same manner: 

(^ii ^ 2 ) ^2) ^ ^2^2)* 

But this is impossible when we start with the system of (positive and 
negative) rational numbers, since the fractions ai bi and b^ do 
not define a cut. 

There is a way cut. Introduce the irrational numbers after the 
fractions; i. e. before the negative numbers have been defined. Then 
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the above definition of multiplication is valid. We thus obtain the 
system of positive real numbers. The negative numbers can now 


be defined precisely as before, and we arrive at the system of real 
numbers. 

What have we lost by this method? Nothing of a logical nature; 
nothing of simplicity in the small. But in the large‘there is a lack 
of unity in the definition of the real numbers. There was no lack 
of unity in the definition of the system of rational numbers (positive 
and negative fractions, and 0). And there is no lack of unity when 
we advance from these to the real numbers by the cut. There is no 
lack of unity when we introduce the fundamental principle of limits 
even before the definition of addition. And from here on the devel¬ 
opment leaves nothing to be desired in point of simplicity. 

All this has, however, an apologetic sound. Our views are ex¬ 
pressed in negatives. It is important to make clear the positive rea¬ 
sons which justify the course we have followed. These are: 

I. The Cut. The phenomenon of the partition of all the 

numbers of the system before us into two classes, the ax and the 

with ^ 

ax < fl2» 


appears again and again in the most elementary and important con¬ 
siderations one meets in practice. It is natural, then, to seize on 
this mathematical manifestation as the defining element in extending 
the number system to its final scope. In Physics, that definition is 
best which lies closest to the heart of the phenomena to be analyzed, 
and this principle has its counterpart in Mathematics. 

n. Limits. The prime object of extending the number system 
is continuity and the existence of a limit. If it were not for these 
phenomena, we could get on very well with the system of rational 
numbers (positive and negative fractions, and 0). Since the notion 
of the limit is the cause for generalizing arithmetic, its place is 
naturally the earliest possible one — immediately after the definition of 
the new numbers. From the point of view of scientific perspective, 
then, this arrangement leaves nothing to be desired. 

So we need make no apology to the beginner for leading him 
over a path that is hard for his tender feet. He is being trained in 
the most important methods of the science, and his efforts will be 
rewarded by the acquisition of insight and power in analysis. 
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The Method of Regular Sequences, It is possible to introduce 
irrationals by a method which is, perhaps, more convenient for the 
beginner. Suppose we have established the system of rational numbers* 
By a regular sequence is meant a set of these numbers, 

^ 3 , * * * having the property that, if c be a positive fraction chosen 
at pleasure, there corresponds an integer m such that 

1 1 < c, m S n, n\ 

The regular sequence is now made the element of a new logical 
class, the real numbers. If, in particular, there is a rational number, 
/I, such that, to an arbitrary positive fraction € corresponds an integer 
m, for which 

1 — iin I < € , m ^ 71, 

this regular sequence is identified with a\ i.e. set equal by defini* 
tion to a. If not, a new number is introduced. In either case, 
the element of the logical class is the mark which consists in the 
regular sequence. 

Two regular sequences, A = (aj, a^^ • • •) and B = (&i, • • •), 

are defined as equal if to an arbitrary positive fraction € corresponds 
a natural niunber m such that 

l^w —M < €, m ^ n. 

The niunber A is defined as less than fi, 

A < B, 

if there are a natural number m and a positive fraction h such that 
an + h < bn, m ^ n. 

By the sum of two numbers, 

C^A + B, 

is meant the regular sequence 

C =5 (fli + 6i, 02+^* *' * )• 

Subtraction is always possible and unique: 
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The product of two numbers, 

C^AB, 

is defined as the regular sequence 

C ~ (tfj[ Uo bof • • •). 

Division by any number but 0 is always possible and unique: 

— =r r . . 1 

B J. 

The justification for each of these definitions; i.e, the requisite 
convergence proof, is simple. 

Thus the System of Real Numbers — the definition of irrationals 
and the extension of the four species to the new numbers — is 
established. The method has the advantage of simplicity in detail. It 
is well for the student, after a first study of the method of Dedekind, 
to work it through in all detail. He will then return to the former 
method with increased power and greater zest. 

The method of regular sequences is a middle-of*the*road method. 
It is an easy way to reach the mountain top. The traveller buys his 
ticket and takes the funicular. Many people prefer this mode of 
travel. But some like a stiff climb over rocks and across streams, and 
such an ascent has its advantages if the heart is good and the muscles 
are strong. 



Chapter HI 

Point Seta. Umita. Continuity 

§ 1. Deilnitiona. By point is meant the expression (.rj,• • •, Xn)* 
The numbers are called its coordinates, A point in space ot 
n dimensions may be thought of as corresponding to it. But this 
idea is introduced merely for the convenience of geometric intuition, 
— not as an essential part of the concept. Any collection of points, 
defined so as to be recognizable, is called a point set. Each point is 
called an element of the set. 

Examples, When n = 1: 

a) The proper fractions. 

b) The continuum a <, x <, b, 

c) The line segment a ^ x S h, 

d) The incommensurable numbers between 0 and 1. 

e) The natural numbers. 

f) Their reciprocals, 1, J, i, • • * . 

g) The numbers 1, J, • * * and 0. 

h) The positive numbers. 

i) All the real numbers. 

j) A finite set of points, like 0, 1. 

When n > 1: 

k) The open square, when /i = 2 : 

-1 < a: < 1, -t < y < 1, 

l) The closed square, when n = 2: 

— 1 < ^ 1, —1 jy ^ 1. 

m) The rational points of space; {xi, • • • , Xn\ whei*e the x^^s 
are all fractions. 

n) The surface of the unit (hyper-) sphere: 

x| + x| • -f- x® =1. 

o) The interior of the unit (hyper-) sphere: 

*? + *1 + • • • + < 1 , 

Distance. By the distance between the points (/<i, * * *, /in) and 
* * *» bf^ is meant the number: 


D — — fri)* + • • — bn)^. 
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Bounded. A point set is hounded if the distances of its points 
from a fixed point are all less than some fixed number. 

Finite. A finite point set is one consisting of a finite number 
of points. 

Open Set. If to an arbitrary point (^i, • • • , fln) of the set there 
corresponds a positive number h, dependent in general on («), such 
that all points * * • » ^n) for which 

aj,’- h< Xk< ak-¥h. A: = 1, • • , n, 
belong to the set, the set is called an open set. 

Neighborhood. By the neighborhood of a point is meant a con¬ 
nected open set including the given point. It is usually a simple 
region, like a square or a circle with the point as its centre. 

Cluster Point. A point A is called a cluster point or point of 
condensation of a set if an arbitrary neighborhood of no matter 
how restricted, contains points of the set distinct from A. 

Isolated^ Discrete. A point A oi di set is called isolated if 
within a suitably chosen neighborhood of A there are no other poinU 
of the set. A point set is said to be discrete if all its points are 
isolated; cf. Examples e), f), j). 

Boundary Point. A boundary point of a set is a point in every 
neighborhood of which there is a point of the set and also a point 
not belonging to the set. The point itself may or may not belong 
to the set. 

Closed Set. A set is closed if it is bounded and contains all 
its boundary points. 

Standard Element. By this is meant the point set (a:i, • • •, 
where 

< ^* < 0 < A = 1,- • •, n. 

The point • •, is called the centre. The boundary points of 
a standard element are those points (^i,* • •, for which 
^ ^ + A*, A: = 1,• • •, n, 

at least one lower sign holding. The closed set consisting of a stand¬ 
ard element and all its boundary points shall be called a standard box. 

Connected. An open set. A/, is said to be connected if it has 
the following property. Let A and B be ainy two of its points. Then 
there shall exist"* n 4- 1 points of the set, Po == ‘ ’* » 
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Pn = B, and n standard elements, Rq, Ri, l{n-i> where the 
centre of Rj^ is Pjt and R/t lies in M, such that R/t contains 
^ SS 0, 1* • • s « — 1. 

Dense, A point det is everywhere dense in an open set if each 
point of the latter is a cluster point of the former. It is intrinsically 
dense if each of its points is a cluster point. 

Perfect, A set is perfect if it is closed and intrinsically dense. 
A closed interval, a ^ x ^ \s dji example of a perfect set. But 
a perfect set does not necessarily contain any open set whatever; 
cf. § 2. 

Linear Point Sets 

tipper Boiirul, Upper Limit, A linear point set, i. e. a set for 
which 71 = 1, is said to have an upper hound if there is a fixed 
number A such that 

X ^ A, 

where x is any point of the set. Any larger number, B > A^ is 
also an upper bound of the set. 

If A belongs to the set, or if there are points of the set in 
every neighborhood of At then A is the upper limit (or least upper 
hound) of the set. 

When the upper limit is a point of the set, it is c<illed the 
maximum. 

For example, the number 2 is an upper bound of the proper 
fractions. The number 1 is their upper limit. But the set has no 
maximum. 

It is obvious how lower hounds lower limit or greatest lower 
howid^ and minimum should be defined. 

TiiEOHi M 1. linear point set which has an upper boundt 
has an upper limit. 

Let be a fraction, to the right of which lies a point of the 
set. Consider the totality of such fractions. Let 02 be any fraction 
not an a^. Then these two classes of fractions define a cut, {ait a^% 
and thus determine a point, U = (aj, This point is the upper 
limit of the given point set. For, 

i) it is an upper bound. Suppose there were a point £ of the 
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set, S'lch that ^ > U, Then there would be a fraction, a, between 
and £ : 

// < a < £. 

This fraction would by definition be an 

a = 

Thus we have the contradiction of an ai > U, 

ii) U is the least upper bound. For, suppose A < U were an 
upper bound. Then there would be a fraction between A and U : 

A < ^ < [J. 

But p would by definition be an and so we should have the con¬ 
tradiction of an ^2 

Similarly, a linear point set which has a lower bound, has a 
lower limit. 

By a finite interval is meant a point set 

a <. X < by 


to which may be added one or both of the end points. 

Theorem 2. The WEiaiisrRASS-Boi.ZANO Thfo-rkm. An in* 
finite linear point set which lies in a finite interval has at least 
one cluster point. 

Consider the points x of the line, such that, if or' be any one 
of them, only a finite number of points of the given set (in particular, 
none whatever) lie to the left of x. This point set is bounded from 
above. It has, therefore, an upper limit, G. This point, G, is a 
point of condensation. For otherwise it would be an isolated point 
of the set, or not belong to the set at aU. In either case, there 
would be a point x to the right of G. 

The theorem is true for a point set in space of n dimensions. 
It can be proved conveniently by means of the Covering Theorem, § 11. 


§2. An Example. Consider the interval 0 ^ x ^ 1. From 
it we proceed to remove 


certain points. The point 
set we thus construct con¬ 



sists of the points that reiiiiiin. 
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Step 1. From the middle of the interval remove the points of 
an interval of length 

I, = x-|x, 

where 0 < X ^ 1 is a constant chosen once for all. More precisely, 
the points removed are those for which 

11 11 
2 2 - 2 2 ^ 

Step 2. From the middle of each of the remaining intervals 
remove an interval whose length, 4* such that 

/, +2Z2=X-1.X 
4 

More precisely, the points removed are those for which 
— -~4< X < a + 


where a denotes successively the mid-point of each interval remaining 
after the first step. 

n-th Step, From the middle of each of the intervals remaining 
after the (n — l)-st step remove an interval of length /i,» where 

A + 2 4 + 2*/8 + • • • + 2" 14 = X-5—X. 

/I -T 

Those points which remain, no matter how large n be taken, 
constitute the set we undertook to construct. 

The set is perfect, for it is closed, and each of its points is a 
cluster point. It is, however, dense in no interval, for an arbitrary 
interval contains intervals which have been reriioved. 

The sum of the intervals removed up to the {n 4- l)-st step 
approaches a limit, namely, X, as n increases. 

The points of the set can be enclosed in a finite set of intervals, 
the sum of whose lengths, however, will exceed the value 1 — X. 
If X = 1, this sum can be made arbitrarily small. But if X < 1,- 
this is not the case. 

Curiously enough, the points of the set admit a simple arith¬ 
metic expression when X = 1. They are the numbers 

fitf <X>2 

X = 0.0.10.2 + ^ + ••• 
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expressed in the triadic system, where the a*s take on at pleasure 
the values 0, 2. 

Incidentally, these points can be transformed on the points of the 
closed interval, but not in a one-to-one manner. Let 

- 1 

Pn == ~ 

and consider the number y expressed in the diadic system as 

y = 0. Pi 02 Ps • • • = Y + ^ ^ + • • • . 

It is obvious that every number y of the interval 

0 ^ y ^ 1 

is thus obtained at least once, but some points are obtained twice. 
Thus we have a transformation of the points of a closed interval on 
the points of a perfect set which is nowhere dense in any interval 
some points of the former set even going over into two points of the 
latter. 

§3. Functions. Let an arbitrary point set M in space of n 
dimensions be given. Let (xi, • • •, Xn) be any one of its points, P. 
Let a number y be assigned to P by any law whatever. Then y is 
called a function of P: 

Represent ais a point of the linear manifold, Ni. Then the 
law whereby the function is defined establishes a transformation^ of 
the points of M on the points of JVi. This transformation can be 
represented by the aid of the surface (i.e. hypersurface, manifold), 
defined by 1) in space of n -f 1 dimensions. Call it S, In the 
simplest case, n = 1, S is a curve, provided that Af is an interval. 
But it is not this manifold apart that expresses the idea of the func¬ 
tion. It is only when we relate it to the manifold M and think ol 
it as the collection of points which have gone out of M by the 

given transformation, that we reproduce the entire conception of the 

function. Thus when n = 1 we may draw the picture of the set 

of vectors parallel to the j^-axis, the initial point lying in (x, 0) and 

• Garatheodory begins his account of the conception of a function with the 
words: Der moderne Begriff einer Fimhion deckt sick mit dem «n€r Zuordmmg. 
Cf. his VorUsungen uber reelle Funktioneriy p. 71, j 83. 
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the terminal point in (or, ^). This manifold of vectors, localized as 
staled, does give a complete account 
of the oonoeptioii of the function. 

The locus of their terminal points is 
the manifold £. But 2 by itself 
does not yield the conception of the 
funcition. It is only when we think 
of 2 as defining the set of vectors, 
that we arrive at the basal idea of 
function. 

On the other hand, since the manifold 2 does determine uniquely 
the set of vectors, it yields a means of defining or representing the 
function. The function is the set of vectors. The manifold 2 stands 
in a one-to-one relation to the oxicept: function, and for many pur¬ 
poses can be used to represent the function, with the consciousness 
of the vectors. 

We have spoken only of the case of single-valued functions. The 
extension to multiple-valued functions is obvious. 

At the beginning, we spoke of as the function. Thus we 
tliould say: The value of the function 

+ 1 . 

when X = 1, is 2. This is a different meaning of the term. Both 
meanings exist side by side in common parlance, but no confusion of 
ideas arises from these two uses of the word. 

§4. Continuation. In the last paragraph we thought of the 
domain of definition of the function as a point set; and we trans¬ 
formed each point P of tlie set on a point y of the linear manifold. 
We may express this idea trenchantly by saying: ^ is a point func¬ 
tion, and write: 

1) r =/(P). 

We may generalize this idea by beginning with a set of mani¬ 
folds. For example, we might take an arc of a curve, like-an arc 
of a circle, or an arc of a continuous curve that has no tangent 
(Chap. IV, S 2) or an arc of a simple Jordan curve (Chap. VII, § 10) 
and then inscribe a broken line. These broken lines would serve as 
an illustration of such a set of manifolds as we have in mind We 
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might attach to each element (i. e. each broken line of the set) a 
number, namely, its length, y. Thus a transformation of the ele¬ 
ments of this set of manifolds on the points of a linear manifold 
would be defined, and this transformation gives us an extended idea 
of the concept Junction. If we let M refer \o any one of the broken 
lines, we could write suggestively 

2 ) 

and call r a function of M. 

Again, consider an arbitrary bounded point set S in the plane. 
Let M be a polygon, or a number of polygons, each set M contain¬ 
ing the points of S in its interior, and each member of a given set 
M being boimded by lines parallel to the axes. More precisely, these 
lines shall be chosen from the lines 

5) r = |:. 

where n is a natural number and p, q are whole numbers. To each 
of these sets M we could attach the number y which represents its 
totad area*, and thus each M would be transformed on a point of a 
linear point set. This transformation may be taken as an example of 
the extended concept function. 

Another example is given by removing the requirement that the 
sides of the polygons lie along the lines 5), and allowing them to be 
any parallels to the axes. 

These examples illustrate the generalization of the concept fwic- 
tion^ which we will now formulate as follows. G>nsider a collection 
of point sets A. Each A may be any point set one pleases to define 
in space of n dimensions. The totality of these A*s shall be referred 
to as the manifold, tt, of the A^s. To each A shall be attached a 
number, y. Thus the elements A ot tl are transformed on the points 

• For purposes of illustration we could also take as y the total perimeter, 
or the sum of all the diagonals. 

On the other hand, S might be an arbitrary manifold in qpace, and M, a 
polyhedron containing 5; its sides, or faces, lying in the planes: 



The extension to space of any number of dimensions is now obvious. 
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of a line. This transformation is a concept which we denote as a 
function. We write: 

r =/(.A 

and say that ^ is a function of A. The manifold is the domain 
of the independent variable, A\ or the domain of definition of the 
function. 

A third extension of the concept function is the following. We 
start, as in the last case, with a manifold ^ of point sets A^ and 
now we assign to each A a point set B according to any law what¬ 
ever. Denote the manifold of the B by ©. Then this transformation 
of It on 59 through A —► B shall also define the concept function. 
Thus in polar reciprocation a plane determines a point. 

§ 5. Limits. We begin with the simplest case of a function, 
I) r =f{x\ 

defined in the points of a linear set A. T-et a he a cluster point 
of A. 

By the S-neighborhood of the i)oint a we mean the point set 

n — S ^ ^ u S f 

or, what is the same thing, the points x for which 

\ X — a \ < 

By the abridged S -neighborhood of a we mean the point set 
(<y)^ obtained from {S)a by removing the point a\ i. e. the point set 

iS)!,: 0 < I *-al < #. 

Definition, The function f{x) shall be said to approach a 
limit when x approaches a if to an arbitrary positive € there corre¬ 
sponds a S such that 

where x\ x" Ju-e any two points of {S)a which lie in A, 

According to the theorem of Chap. II, §6 there then exists a 
number b such that, to an arbitrary c-neighborhood of b, 

(«)i : I 7 - * 1 < €, 

tltere corresponds an abridged ^-neighborhood of a, (d)a> with the 
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property that the value y of the function for an arbitrary x of A 
lying in (S)!, is a point of («)j, or: 

I b -fix) I < £, 0 < I * - a 1 < #. 

where x lies in A. 

Conversely, if f{x) has the latter property, then it approaches a 
limit. 

The number b is called the limits and we write: 

2) lim f(x) = b. 

x—a 

Relation to the Earlier Definition, The relation of the present 
definition of a function's approaching a limit to the earlier defini¬ 
tion of the limit of a point set is as follows. Here, we start with 
a variable point set, namely, the points { a; j of A which lie in the 

abridged ^-neighborhood of i.e. in This point set, jx}, 

approaches a limit, namely, n, as S approaches 0, by the definition 
of Chap. II, § 6. 

By means of the function 1) this point set j a: j is transformed 
into a point set {j^j, depending on S, And now the function 1) is 
said to approach a limit if this latter point set, {jyj, approaches a 
limit in the earlier sense. 

Notation, This symbol, Equation 2), shall have the following 
meaning: i) it asserts that f{x) approaches a limit as x approaches 
a\ i.e. it vouches for the existence of a limit; and ii) it asserts that 
the value of the limit is the number b. 

Theorem. Let Ai be a sub-set of A having a as a cluster 
point. If f{x\ regarded as a function whose domain of definition 
is approaches a limits when x approaches a, then f (a;), regarded 
as a function whose domain of definition is will also approach 
a limits when x approaches a, and the two limits wiU be ecjual. 
But the converse is not true. 

Unilateral Approach* If the points of A near a lie above 
i.e. if X a, and if f{x) approaches a limit, we may write: 

3) lim f{x)\ 

X=i«+ 


with a similar definition I’or 

4) lim f{x). 
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If, on the other hand, f{x) ^ b, we may write: 

5) lim /(x) = b^. 

xaaa 

Simihurly, if f(x) ^ b, we may write: 

6) lim fix) = 

x^ssa 

Of course, definitions 5) and 6) can be combined in all possible 
ways with 5) and 4). 

Becoming Infinite. The function is said to become positively 
infinite: 

lim fix) =+ 00 , 


if to a number G chosen arbitrarily large there corresponds a S such 
that 

G < fix), 

where x is any point of iS)a which lies in A, 

The corresponding definition for becoming negatively infinite, 
Ihn fix) = - 00 , 


is obvious. 

We say, fix) becomes infinite : 

lim fix) = 00 , 

'f becomes positively infinite. 

A necessary and sufficient condition that fix) become infinite, 
or positively infinite, or negatively infinite, is that 

1 _ A _ i:_ I Q+ _ 1 :_ I 


lim 


/w 


= 0 . 


or 


lim 


/U) 


or 


lira 
x^afix) 


= 0~ 


The independent variable x may of course appiuach a unilaterally. 

Poles. When a function fix) becomes infinite at a point a, it 
is customaiy to say that the function has a pole at and to write: 

fia) = 00 . 


No statement is thereby made as to whether the function is defined 
in the point a, or if it is, what its value there is. Thus if 




* 9 * 0 ; 
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it is true that 

y*(0) = oo and /(O) = 0. 

The last equation states the value of the function when ar = 0. The 
first equation has no concern with the value of the function when 
jp = 0. It makes a certain assertion about the function when x ^ 0. 

Independent Variable Becoming Jnfinite, Hitherto we have 
considered only the case that the domain of definition A of the 
function / (a:) has a cluster point x = «. If has no upper bound, 
we say that f{x) approaches a limit when x becomes infinite (more 
precisely, positively infinite) if to an arbitrary positive € there cor¬ 
responds a number G such that 

\fW)-f{J^)\ < € 

for any tvm points x', x" of lying in the interval 

G < X. 

This interval is the analogue of the abridged ^-neighborhood {S)^ of 
the point x ^ a. There then exists a number b as before, such that 

|J-/(X)1<€. & < Xi 

and we write: 

lim f(x) = b 

or, more precisely: 

lim fix) = b. 

The definition 

lim fix) = b 


is now obvious; as are also the 
definitions 

lim fix) = etc. 

Exercisk 

Illustrate each of these de¬ 
finitions by a suitable figure, 
carefully defined, such as is 
suggested by the diagram. 




JL 






1 



o 

b-t 






• 

1 

1__1 


.r 



A~S a a>S 
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Exercises* 

1. Show that the function 

. 1 

y X sm — 

X 

approaches the limit 0 when x approaches 0. 

2. Show that 

lim- - —P* = 0, Bm —~—p = \. 

3. Does the ftinction 

^ ^ sin :r 

become infinite when or = oo? 

4. Show that the function 

y = a: + 2 sin :r 
becomes infinite when ar = oo. 

Does this function steadily increase as x increases? 

5. If f (x) approaches a limit as x approaches a, juid if 

A < fix) < B, 

show that 

A ^ lim fix) ^ B, 

6. Let fix) approach a limit when x approaches a, and lei 
there be no iS)a in which fix) is constant. To a jriven c cor¬ 
respond infinitely many values ol <5^. Show that, for any ^iven € 
below a certain positive const<mt: c •< A, these (f’s form a hounded 
set, and this set has a iiiaxinuaii. 

§6. Bounded Functions. A function fixiy**',xn) is said 
to be bounded at the point P if every neighborhood of P contains 
a point of the domain of definition A of the function and further¬ 
more there exists a certain neghborhood U of i* and a positive con¬ 
stant M such that 

\f{xir-.x„)\ < M 

for all points of A which lie in U. 

• In these Exercises, wliich serve solely us illustrations, the properties of 
the elementary functions are assumed. A systematic developemeiit of these 
functions will presently be given. 
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Thus the function 

1) r = sin — 

X 

is bounded ai the point x = 0. Again, the function 

2) r = . 0 < a: ^ 1 

-t' 

is bounded at every point of its domain of definition. 

A iunction is said to be bounded in a region if tlie region 
contains a point of and if there exists a positive oontant M sucii 
that 

1/(•»;)>• • I < M 

for all points of A which lie in the region. 

Thus the function 2) is hounded in every point of its domain 

of definition, but it is not bounded in that domain. 

A function may be bounded at a point, as 

. 1 
V = sin — 

X 

at the point x = 0, or it may have a pole at the point, as 


1 



at the point a: = 0. But 
these two cases do not ex¬ 
haust all the possibilities. 
Consider the function 

5) x^O. 

X 

This function is obviously 
not bounded at the point 
X = 0, for sin - = 1 when 
a; = 1/(5 + 2 A:t), and the 
function has the value 

I + 

But the function does 
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not have a pole at the point x = 0, For, sin ^ = 0 when x = l/Ar , 
and so the function vanishes there. Hence it does not become 
infinite when x approaches 0. 

We see, then, that the behavior of a function at a point involves 
a three-fcid classificationi 

i) The function may be bounded at the point; 

ii) It may become infinite there; or 

iii) It may neither be bounded nor become infinite there. 

OsaUatim- Let a function be bounded in a region. Let G be 
its upper limit and its lower limit. The difference: 

D^G-K, 

is defined as the oscillation of the function in the region. 

Let a function be bounded at a point a, and let j be so chosen 
that the function is boimded in (j) 4 i. The lower limit of the oscil¬ 
lation D for such regions {S)m is defined as the oscillation of the 
function in the point a. 

§ 7* Three Theorems on Limits. Theorem I. If each of 
two variables^ X and T, approaches a limits their sum approaches a 
limits and the limit of their sum is equal to the sum of the limits: 
lim(A’ + T) = lim a: + lim Y. 

We will prove the theorem for the case of functions of a single 
variable x with a cluster point x = a o[ the domain of definition, 
Af. The proof admits of immediate generalization to all the higher 
cases that arise in point functions. 

Let the limits of X and T be ^ and B. Let 

x = d + Cf r=B + f|. 

Then C and q are infinitesiinals; i.e. variables which approach the 
the limit 0. More precisely, to an arbitraxy c > 0 there conesponds 
a positive d such that 

1) I C I < <1 0 < I or — I < #, X xa M. 

Similarly, 

2) I f| 1 < c, 0 < I X — 1 < #', X in M. 

We may, however, without loss of generality drop the prime, setting 
= d, because a given S can always be replaced by any smaller 
positive d. 
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We wish to prove that, to a positive c chosen at pleasure there 
corresponds a positive S such that 

3) I ^ + B — (X + T) I < €, 0 < 1 j: — I < X in M. 

Now the c’s that appear here — the c of 1) and 2), and the c 
of 3) — are of different origins. The first c (call it c') is a number 
at our disposal. We can choose it to suit our purposes. But the 
second e pertains to the conclusion. It is given us, as it were, by 
our adversary, and we have to meet it, — to find a S that wUl 
match it and make 3) a true relation. In other words, we have to 
prove that to the € of our adversary corresponds a positive S such 
that 3) is true, or: 

4) |C-|-i,l<€, 0<\x-a\<S. 

it being understood henceforth that x lies in M. 

To do this we infer from 1) and 2) that 

ICI + !iI<2€', 0<|x-<i|<#. 

Furthermore, 

IC + '?l = iCI + lnl* 

Hence 

iC+ll<2«'. 0<|x —al<J. 

If, then, we choose our e' so that 2 e' c, the relation 4) will 
be fulfilled, and thus the theorem is proved. 

Theorkm n. 1/ each of two variables^ X and T, approaches 
a limits their product approaches a limits and the limit of their 
product is eqixal to the product of their limits: 

lim(Xir) = [limX][lim Y]. 

We wish to prove that to an arbitrary positive c corresponds a 
positive i such that 

5) |^B-Xr|<€, 0<\x-a\< S. 

And we know that, when we dedde on an c' > 0, we can find a 
d > 0 such that 

1C1<€'. Inl<«'. 0<\x-a\<9. 

Now, 


Xr = jiB + BC + Ati + in- 
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Hence 


^ |B1 It +Ui lil + ltl 111 S [U| + |BH-€'J«'. 

It remains merely to show that w'e can choose our c' so that 
this last expression is less than our opponent’s €. This can be done 
conveniently by first restricting c' to be < 1, and then restricting 
c' further by the conditioti; 

+ €. 

Thus the proof is complete. 

Thi:orem hi. If each of two variables^ X and T, approaches 
a limits and if lim Y ^ 0^ then the quotient X/Y approaches a 
limits and the limit of the quotient is the quotient of the limits: 

y \ lim X 
If) = lim-F* 


6 ) 


The relation which here corresponds to 3) and 5) above, is: 


X 

B Y 


< «, 


0 < I x — a I < d. 


Now, 

^ _ 

B Y B B+fi BY * 
First choose S so that 

\Y\>^ 15 | 

Then 

^ „ Ul-hl + IBI-ICI 

- ^- w -’ 


B Y 


and the remainder of tlie proof presents no diiBculties. 


Exercises 

1. If X approaches a limit, and if C is a constant, then 
lim (X + C) = lim X + C; 
lim(CX) = ClimX; 



, provided lim X ^ 


0 ; 


limX" = (limX)". 
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2. If JYj, • • • , JY/, are variables, each of which approaches a 
limit, and if • • •, are constants, then 

lim (Cl Xi + • • • -f C» Xn) = Cl lim Xi + • • • -f C„ lim X„. 

3. If, furthermore, Ei^ • • \ En are constants, then 

lim ^1-^ 1 + • * * + C n X„ _ Cl lim Xi 4 - * • • -I - Cn lim_Xn 

Xi + * ‘ + -En Cl lim Xi 4- • • * Cn lim Xn * 

provided 

Cl lirn Xi 4- * • • + En lim Xn ^ 0. 

4. Show that, ii f (x) is a function which is bounded at the 
point X = Uy and if 

lim if (x) = 0, 

T=a 

then 

lirn f (x) (p(x) = 0. 

X- a 

5. If G (x) is a polynomial in x : 

C (or) = Co x" 4- Cl H- ]- Cn; 

and if X is a variable which approaches a limit, then C(X) ap¬ 
proaches a limit, and 

lim G (X) = Co (lim X )" 4- c, (Jim X 4- • • * +c„. 

6. State and prove an analogous theorem relating to the quotient 
of twn functions: 

y ( 5 ). 

fM ■ 

7. If each of the variables Xi, X 2 , * * *, Xn approaches a limit, 
and il C(xi, • • •, Xn) is a polynomial, then 

C(Xi, --^Xn) 

approaches a limit. 

8. In only one of the foregoing questions is an €-proof required. 
Which one is it? 

9. Each ot Questions 1 — 7 contains one or more existence 
theorems. Did you prove the convergence^ i. e. the existence of the 
limit, each time? 
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Continuoui Fanctioiis. Let f{x) be a fiinctioa defined 
in the p«^ts of a wt A, and let x = a be a cluster p«nnt of A. 
The function is said to be continuom in a if i) fix) approaches a 
limit when x approaches a; ii) the value of this limit is fia ): 



lim/(ar) =/(«). 

Xaaa 

By § 4 this means that, to a positive € chosen at pleasure, there 
corresponds a j > 0 such that 

l/^«) “"/(^) 1 < I X — n I < #, X in A. 

The funcdon is said to be continuous in A if it is continuous 
in every point of A. 

The region A wUl usually consist of an interval, open or closed, 
finite or infinite. By a closed intervcd h) is meant, we recall, 
the set of points 

X S h. 


The definition may be illustrated geometrically as follows, Fig., 
p. 73. Plot the point (a?,^) = (a, ft), where ft =/(«). Draw the 
horizontal parallels 

jy ss 2^ 4. c, ^ = fc — €. 

The point (tf, ft) lies within the strip bounded by these lines. And 
now the definition says that there is a vertical strip bounded by the 
lines 

such that, when x lies between a — S and n + ^, the corresponding 
point {x^y) lies in the rectangle common to these two strips. 
Example 1. G>nsider the function: 

f (:r) = x, when x is rational; 

y'(x) = — X, when x is irrational. 

This function is continuous for x = 0, but for no other value of x. 
Example 2. The function: 

f{x) = 1, X irrational; 

f{x) = 0, X rational, 

is bounded. It is discontinuous for all values of x. 

Example 3. Let f{x) be defined in the interval 0 ^ x ^ 1 
as follows: 
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i) 

/(O) 

=/(i) 

= ii 

ii) 

nh) 

_ 1 
“ 2! 



nh) 

_ 1 

31 ’ 

p=l,2,4,5; 

n) 


_ 1 
n\ * 


where p/n ! is 

a point of the interval. 

in which/( t) has 


been defined. 

Finally, f (x) = 0, irrational. 

This function is discontinuous for all rational values of or, and 
continuous for all irrational values. 

Example 4. The function ^(x) obtained from the function 
y (x) of the preceding example by periodicity : 

• f)(x) =/(x), 0 < X ^ 1 ; 

4- 1) = — oo < r < oo. 

Theorem 1, If J‘(x') is continuous in the point x = £, then 
f {x) is bounded in this point, 

^ ^hen f{x) does not change sign or vanish in the 
neighborhood of x ^ More precisely: 

V /(£) > then 

c < fix) 

in a certain neighborhood of £. 

If /(£) < c, then 

fix) < c 

in a certain neighborlwod of £. 

The proof follows from the fact that 

/(£) - € < fix) < fii) + €, I X - £ I < r in 

on setting € = ] jTCj) — c 1 

Theorem 2. A continuous function of a continuous function is 
a continuous function. 

More precisely,, let y^ ip ir) be continuous in a given point 
set ,4^ and let 
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« =f(x) 

be continuous in a point set B. Let \ y\ be the point set defined 
by the values of *p{x). Let B contain { y j. Then the function 

«=/[v’W] 

is continuous in A. 

The proof is left to the reader. 

Exercises 

1. If y (:r) and tp (j:) are continuous in the point x = or in 
the region then 

i) f {■'■) +>p{x\ 

ii) fix) fix), 
are continuous there. Moreover, 

iii) 

is continuous in a or in a point £ of A, provided ^(a) ^ 0 or 

ipii) ^ 0 . 

2. The function 

is continuous for all values of x. Give a careful 6-proof of this 
theorem. 

3. The function 

7 = « = 2, 3, 4, •• •, 

is continuous for all values of x. Prove this theorem without the 
use of c’s, employing only the theorems of Question 2 and § 7. 

4. Every polynomial in x is continuous for all values of .r. 

5. A rational function 


fix) 

fix) 


ip{x) 


where y(.r) and (p{i) + 0 are any polynomials in x, is continuous 
lor all values of x for which ^(.r) ^ 0. 

6. If a function is continuous in a closed interval and vanishes 
there, show that its roots form a closed point set. 

Is the theorem true ii the interval is bounded, but not closed? 
(nve an example. 



POINT SE'rS. LIMITS. CONTINUITY 


83 


7. Plot the graph of the function: 

, .1 

/ U) = X sin —, X Oi 

X 

/(O) = 0. 

Prove that the function is continuous for all values of x. Assume 
that sinx is continuous and bounded. 

§9. Three Theorems on Continuous Functions. 

Tmeorkm 1. A function f {x\ continuous in a closed interval^ 
a ^ X ^ 

Assume the theorem false. Divide the given interval, (tf, 
into two equal subintervals. Then the theorem must be false for 
at least one of these. Itet 

ai ^ X ^ Pi 

be such an interval. If there is a choice, take, for definiteness, the 
left-hand interval. 

Repeat the reasoning, subdividing (ai, pj),. and denoting a sub¬ 
interval in which the theorem is false by 

ag ^ a: ^ p2. 

If there is a choice, take, for definiteness, the left-hand interval. 

Proceeding in this manner we obtain a succession of numbers 

a„: 

**1 ^ ®'2 ^ 01 ; 

and a second succession : 

Pi ^ p2 S Pn > fltl. 

Moreover, 

Pn-*" = —m ^ n. 

These numbers determine a point 5 such that 

a„ g ^ Pn. 

Since f{x) is continuous in x = £, we have: 

l/(£)-/WI<«. |x-i|<«r. 

or 

l/Wl < 1/(£)I + €. 1 x-«|<^ 
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Let m be so chosen that 

fim ““ ^ 

Then the interval (am, Pm) lies within the interval (£ — #, C + #), 
and here is a contradiction; for in no interval (a^, 3n) is the func¬ 
tion bounded. This proves the theorem. 

Remark, Observe that the theorem is not true for an infinite 
interval, — witness the function 

y ^x. 

And it is not true for a finite interval which is not closed; witness 
the function 

y = ~, 

X 

Theokkm 2. If a function f{x\ continuous in a given interval^ 
changes sign^ it vanishes at a point of the interval. 

In this theorem it is not necessary that the interval be closed. 
It is enough that it be connected; i.e. if a and h are two of its 
points, then the closed interval {a, b) shall belong to the given 
interval. 

Let be a point of the interval. If f{a) = 0, we are through. 
If not, f{x) must change sign to the right of a or to the left of a. 
Suppose the former is the case. Then there will be an interval, « 

a ^ x <. y 

in which f{x) does not change sign; Theorem 1, §8. Let S he the 
upper limit of all such numbers, £ . Then £ is an interior point 
of the interval of definition, and 

/U) = 0. 

For, if fit) ^ 0, then there will be a certain neighborhood of £ in 
which fix) will not change sign. But this is in contradiction with 
the assumption that £ is the upper limit. 

Tui.oiu.m 3. A function fix)^ continuous in a closed interval^ 
a ^ X b, 

has a maximum and a minimum. 

By a maximum is here meant a value, M, taken on by the 
function in one or more points of the interval, and not exceeded in 
any point: 
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/(£) = M for some a ^ ^ ^ h \ 

J {jc) ~ M for every x, a S x S b. 

Similarly for a minimum. 

For example, the function 

y = const. 

has a maximum in every point j: = £ of the interval; and it also 
has a minimum in every point. 

Again, the function 

f{x) = x, Oga:<l; 

/U) = l, i < X ^ 2; 

f{x) = -i-x, 2 < X g 5 

has a maximum in each of the points 1 ^ ^ 2 and a minimum 

in X = 0, 5. 

Proof. Gmsider the point set \ y\, where 
y=f{x). 

It may consist of a single point. In any case, by Theorem 1, it is 
bounded. Let M denote its upper limit 

The theorem asserts that the point set has a maximum, i. e. 
that M is a point of the set. 

Assume the theorem false. Then f {a) < M. Let y be a 
number between f {a) and M: 

f(d) < y< M. 

The equation 

fix) - v = 0 

has roots, by Theorem 2, and these form a closed set, by § 8, Ex. 6, 
Let £ be the smallest root. 

Assign to y a succession of values : 

yi < y 2 < •••* lini yn = M. 

n oo 

The corresponding roots will have the property: 

£i < £2 < •••. ^n< b. 

Hence £n approaches a limit: 

lim £11 = £, 
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and £ is a point of the interval (a, 3), since tliis is closed. It follows, 
then, from 

yn (£ 71 ) 

and the continuity of with the aid of § 5, Theorem, that 

lim = li n /(£») =/(lim £„) 

or 

M =/(£), q.e.d. 

EXKRCiSKS 

1. Prove Theorem 1 by the m«^thod used for Theorem 2; i. e. 
begin with an interval /i ^ x ^ £♦ in which f {x) is bounded. 

2. Prove Theorem 2 by the method used for Theorem 1. 

3. Give two new proofs of Theorem 3. 

4. Devise a new proof for* Theorem 1. 

5. The same for Theorem 2. 

6. Prove the following theorem. I^et f{x) be positive in every 
point of a closed interval, and let it have the lower limit 0. Show 
that there is a point of the interval, in every neighborhood of which 
the lower limit is 0, 

7. Let fix) be defined in the interval 

a X ^ 

and let it be bounded from above. Let it have no maximum. Show 
that a set of values .r^, .r 2 , • • • exists having c as their sole clustei 
point and such that 

lim /(x») = G, 

where G is the upper limit of the function fix)» 

8. If the function 

J=/(x) 

is continuous in the interval 

a S X ^ b 

and is mono ionic increasing: 

/(x^) < /(x"), x' < x", 

show that the inverse function: 

x^Fiyl 

is monotonic increasing and continuous. 
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§10. Uniform Continuity. To say that a function, /(x), 
is continuous at a point J means that to a positive c chosen at 
pleasure corresponds a ^ > 0 such that 

-- fix) I < €, I :r — y I < #, x, y in y. 

Let €, once chosen, be held fast, and consider the #’s correspond¬ 
ing to the different points x* of A, These ^’s will in general be 
different for different y’s, and even when the maximum is chosen 
each time, it may sink below an arbitrarily chosen positive constant, 
h. For example, if 

f{x) = —, 0 < X ^ 1, 

X 

the value of S obviously drops below any given h for some values 

of y. 

But this is not the case, for example, with the function 

y(x) = y, 0 ^ X ^ 1. 

The worst points y ; i. e. those for which S has its smallest value, 
are obviously those for which the graph of the function is steep¬ 
est— here, y = 1. And so we can set 



and this S will fit any x' of the interval. 

We are thus led to the following 

Definition, A function fix) is said to be uniformly cojiimuous 
throughout its domain of definition. A, if to an arbitrary positive t 
there corresponds a fixed positive S which will apply to any poini 
x' of ^: 

1) l/W —/(x') I < €, |x — x'l<#; X, x'in/i; 

S, independent of x, x'. 

Theorem. A function f (x) which is continuous at every point 
of a closed interval («, h) t 

a ^ X ^ 

is un^ormly continuous throughout that interval. 



88 


FUNCTIONS OF RFAL VARIABIJES 


Proof, € be an arbitrary positive number, once clioseii and 
then held fast. We wish to show that a positive constant, exists 
such that 

2) 1/U')—/(•i') I < «. !!•»■-J-'l < <y. r, a-'in 4 . 

When a subinterval 

X ^ /A a ^ a! < ^ b, 

is sucji that, lor some fixed > 0, where S' depends on A'\ but 
not on X, the relations hold: 

|/(x)-/(x')| < €, |x-y < S', x,x' in A', 

w'e shall say that A' is of Class (c). This is the particular € chosen 
at the outset. It does not change in the reasoning that follows. 

If two intervals, d' and A", each ol Class (c), overlap, it is 
obvious that the composite interval made up of A' and A" is also 
of Class (e). 

There exist intervals of Class (c). For, since f {x) is continuous 
at X = a, we can choose c' = i € and then find a. Sq > 0 such that 

I / W - f{a) I < €', 0 ^ X - a < So. 

Then 

\fU')-fia)\ < €', 0 ^ x'-a < So. 

Hence 

\f{x)-f{x')\ < 2e' = c, 

0 ^ X — a < 0 ^ x' — a < (Jq. 

If, then, we choose y so that a <, y <. a + So, the interval 

5) a ^ X ^ y 

will be of Class (c). 

Consider the totality of intervals 3), y now being unrestricted, 
which are of Class (c). Let £ be the upper limit of the y’s. We 
will show that £==!>, and that b is a y. 

Since f (r) is continuous at £, we can choose c' = i € and then 
find a Si > 0 such that 

l/UO ““/(£) I < €'» X in A, 

We now infer as above that 

i/u)-yu')i < c, 

I x — £ 1 < ^ 1 , 1 x' — 5 I < # 1 , x,x^ in A. 
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'rhus if ti be chosen between 0 and or: 0 < the 

interval 

4) £ — #1 = ^ ^ + # 1 , X in 

will be of Class (c). 

On the other hand, there is a value yi of y arbitrarily near £, 
and so, in particular, 

l-S[< y,. 

Thus the interval 3) for y = yi, overlaps 4). Hence £ = ^ and b 
is a y. This proves the theorem. 

Second Proof, The theorem can also be proved as 'follows. 
Assign to each point x of the interval the maximum value of S for 
which 

l/U)——:r'| < J in A, 

Here, € is the fixed value chosen at the start. Thus a positive 
function, f (x), is defined in each point of the interval. We 
wish to show that its lower limit is positive. Suppose it were 0. 
Then the point set (x, tf) in the (x,jy)-plane would have a cluster 
point (c, 0). In fact, if {a^ 0) is not such a point, let the interval 
a'^x^y^bho free from cluster points. The upper limit 
of y is a point c, corresponding to a cluster point. 

This leads to a contradiction. For, the function being continuous 
in c, we have: 

l/(c) —/U) 1 < e'. I J —cj < ^^ Jf in 

also : 

1/ W —J U') 1 < 1 a/ — c 1 < S', y in A. 

Hence 

\f{x)-fW) \ < 2 c', 
where x is any point of the interval 

c - -- <y' < X < c + <y', 

)b JL 

and I X — x' I < J <r', both points, x and x', lying in A, Now 
choose c' = J €. I’hen f (x) ^ J throughout this interval, and 
so (c, 0) cannot be a cluster point of the set. 

Third Proof. Still another proof can be given by means of 
the Covering Theorem, § 11. Begin as in the Second Proof with the 
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system of maximum f’s. Then the interval can be covered by a 
finite number of overlapping intervals: 

< ^ < £ + #(£), 

where £ takes on successively each of a finite number of values. If 
h is the length of the shortest interval conunon to two consecutive 
overlapping intervals, 

^ Six) 

for eveiy x of the total interval. 

Exercises* 

1. Show that the function 

1 + 

is uniformly continuous in its domain of definition. 

2. Is the function 

fix) = e‘ 

uniformly continuous i) in its domain of definition? ii) for positive 
values of xl iii) for negative values of x? 

3. Show that the function 

jy = log X 

is uniformly continuous in the region 1 ^ x < + oo, 

4. Is the function uniformly continuous? 

5. If a function is uniformly continuous, is it bounded? 

6. If a continuous function is bounded, is it uniformly cou' 
dnuous? 

7. Ify‘(x) is unifonnly continuous in the interval 

fl < X < &, 

show that it approaches a limit when x approaches h. 

8. If J (x) is continuous in each point of the interval 

a <, X ^ b 

and if f{x) approaches a limit when x approaches show that 
f{x) is uniformly continuous in the above interval. 

* In working these Exercises make use of what you know about the 
Calculus. 
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9. Show that a continiious periodic function is uniformly con¬ 
tinuous. 

§11. Thft Covgrjnff Tk >—X of a closed 
pomt s&t^X'x\lu an interval including this point be assigned. 
Then it is possible to include all points of \x \ in a finite number 
of tnese intervtds r*. 

Let a and b be respectively the minimum and the maximum 
points of { X }. Let (a, y): 

a ^ X ^ y, 

be an interval which can be covered by a finite number of intervals 
Tg. Such intervals exist, for any interval (a, y) included in ra is 
one. Let £ be the upper limit of the y’s. Then £ = and b is 

a r 

For, since the interval extends beyond £, it is impossible for 
£ to be < Hence ^ =^b. Consider the interval r^. It extends 
to the left of b^ and so £ cannot be merely an upper limit for the 
y’s — it must itself be a y. This completes the proof. 

Second Proof. A second proof, more convenient in space of n 
dimensions, is the following. I^et x be any point of {x}. Then a 
certain ^-neighborhood 

O’: —#<£*< x* -b J, A: = 1, • • •, n, 

is contained in r«. But a larger neighborhood, not even contained 
in r«, may be included in some 

other Tgf, Let Sg be the upper __ 

limit for the J’s corresponding to | t T I | _ | j 

the point (x); denote the corre- 
spending o- by o’,. 

It is obviously sufficient to show that {x} can be covered by a 
finite number of o’,’s. This will surely be so if the lower limit of 
Sg is positive. If this were not true, there would be a point (£) of 
{X j, in every neighborhood of which Sg sank below an arbitrary 
preassigned €. But this is impossible, since such a neighborhood 
would come to lie within o’^. 

§ IZ The Axiom of Choice. I^t i x } be a bounded infi¬ 
nite linear point set. We have proved that it must have a point of 
condensation, x = c (Weierstrass-Bolzano Theorem, § 1). It would 
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seem, then, clear that we can pick out a subset, X 2 ,:r 2 , * * *, from its 
points such that 

lim Xfi = c. 

For, let be any point of the set distinct from c. Choose 
€ < 1 c — X 1 and mark off an interval 

c—€ < x< c-f-c. 

Choose a point X 2 of the set lying in this interval and distinct from 
c. Then choose a smaller interval and repeat the process. Thus a 
succession of points Xi, X 2 , x^, • • * is determined. 

Now comes the difficulty. In the process just described we have 
assumed an infinite number of independent choices. What we need 
is a laiu whereby the n-th point is detennined before n is named. 
We do not know, for example, what the n-th digit in the decimal 
expression for i/*T is; but each digit is determined before we say 
what n shall be. 

There seems to be no means of laying down such a law in the 
general case of the point set just considered. And yet, the existence 
of such a set of Xn seems highly plausible — it w’ould be little short 
of perverse to deny its existence. Moreover, an important part of 
modern analysis has been built up on the tacit assumption that such 
a set exists. 

Zermelo was the first to point out this lacuna. He met the 
difficulty by introducing a new axiom, which may be formulated as 
follows.® 

I’liE Axiom ov Choice. Let each point set A in space of n 
dimemiSm a pbint*]}'' of that space. Then there exists 

such a determination whereby P is a point of A. 

The word determine is here used in the same sense as in the 
case of defining a function. Each |)oint set A is transformed into a 
point P by a law such that, when A is nfuned subsequently, the law 
already has its answer, P. Thus, to each A might correspond the 
origin of cooi*dinates. And now the axiom s.iys that, in this manifold 
of laws, there is one whereby P is a jwiut of A for each A. 

• Cf. Caratheodoxy's presentation of this subject, Reelle Funktionen^ p. 35. 
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Thus the determination oi P in A does not come after A has 
been named, but assigns P Xo A before A enters the specific con¬ 
sideration in hand. Or, still in other words, whenever we select a 
point set A, one of its points, P, has already been determined, and 
is waiting for us. 

Returning now to the example with which we opened the dis¬ 
cussion, let us proceed more systematically, beginning with a set of 
positive decreasing c’s: 

0 < ^ € 71 , lim €/i = 0, 

and defining intervals 

Rnl C — €„ < X < C + €n. 

Ijet An be the subset of the given set which lies in Rm the point c 
excepted: 

0 < I :i: — c 1 < €„, X in An- 

And now, by the Axiom, there already exists a point of An\ 
it does not have to be chosen after we arrive at An- It is already 
there to meet us. 

These XnS define a function of n having the property that 
|c —Xnl < €„, m ^ n, 

and so Xn approaches c as its limit:* 

lim x„ = c. 

IlMOO 

A further illustration of the use of the Axiom appears in the 
proof of the following 

Theorem. An arbitrary infinite point set M in space of n 
dimensions contains an infinite denumerable set Pi, Poy • * * 

Proof, Begin with M, To it is assigned a point P by the 
Axiom. Let this be the point Pi. 

Let Ai be the point set consisting of M less the point Pi- 
Then there is already waiting for us, by the Axiom, a point P ot 
Ay, Let this be the point Po- 

Repeat the process, taking ais A^ the point set Ai less P^- Then 
a point P of A 2 is already determined by the Axiom This shall be 

• In this proof, it may happen that the a:„’s corresponding to two different 
values of n are e<jual. For a given n, only a finite number of such coincid¬ 
ences are possible, And they may all be avoided 1^ replacing the total set of 
intervals Rn hy a suitably ^osen subset 
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the point P 3 . And so on. We see that the point P„ existed before 
we began, just as the /i-th digit in the decimal for y/2 existed be¬ 
fore we began. 

Rxerctsks* 

l. _ llie ffn/yyryfn Extend the theorem to 

point sets in space of n dimensions. Begin with the plane and divide 
it into squares by the lines 



Consider those squares which contain an infinite number of points of 
the set in their interior iuid on their boundary. Devise some way of 
picking out such a square so as to avoid the error of the Auswahls- 
prinzip (Principle ot Choice). Carry the proof through in detail, and 
generalize. 

2. The S-Neighborhood of a Point and a Point Set, Extend 
the definition given in Chap. II, § 6 and Chap. Ill, § 5 to a point 
and a point set j :r } in space of n dimensions by means of the standard 
element, 

+ <F, A = 1, • • •, n. 

3. Convergence, l^et a sequence of point sets { a: j in space of n 

dimensions : M \, M 2 , • ’ • be given, tlieir points being denoted by 
(jr) = (j"i, • • x,^. Then shall be said to converge when A = 00 

if, to an arbitrary positive € corresponds an integer m and a point 
({) = • • • , ot Mm such that each (m ^ A) lies in the 

€-neighborhood of (£). 

Show that there then exists a unique point (a) = (aj, • • • , 
such that to an arbitrary positive € corresponds an integer m for 
which lies in the €-neighborhood of [a) when m ^ k. 

The point (a) is called the limit of J a: i or M^: 

lim j j = (fl) or lim = {a). 


• Tliesc Exercises need not all be worked at this stage. It is well for the 
student now to extend his horizon. He may well leave the detailed study of 
this subject until he has become familiar witii the application of the theory 
he has already studied. 
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4. LimU of a Function. Let /{x^, • • •, a;„) be defined in the 
points of Mjcy Question 3, and let 

r =/ • • • » 

Let i JX' j be the succession of point sets N/g corresponding to Mfg, If 
Nk converges, the function /(xj, • • • , X/,) is said to converge, and 
its limit is defined as lim Nj^ = b: 

lim / (xi, ••• ,x„)=zb. 

(x)=- a) 

By this last equation is meant: i) that f(xi, • ••, Xn) converges 
{existence of a limit); ii) that the value of the limit is b, 

5. Extend the definition of Question 4 to the case that Mjg 
lies in a plane and 

lim Xi = a, lim yi = co. 

^=s:o j f-a auo 

Generalize for the two-dimensional case. 

6 . Give a generalization of Question 5 for higher spaces. 

7. When is a function f (< 2 : 1 , • • •, x,^ said to be bounded, i) in 
a point; ii) in a region? When does the function have a pole in a 
point ? 

8 . Define continuity for a function f{xi, • • •, X;t). 

9. In what points are the following functions continuous? 


i) 


ILZ. 


ii) 


xy 


X- -f 7- 


iii) 


3^ -f 

3 ?’ y^ * 


10. What of the functions in Question 9 approach limits when 
{x, y) approaches (0, 0) ? 

11 . Show that the function 


_ 5 . 21 - 

approaches a limit along each straight line through the 6rigin. 

12. Extend Theorems 1 and 2 of §8 to functions of several 
variables. 

13. Show that a rational function: 


A (*i. • • •, *>i) = 






where f{,Xi, and •••,•*' 11 ) **« polynomials prime to 

each other, is continuous at all points at which it is defined. 
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14. Does R (xiy • ••, Xn\ Question 15, have a pole at a point 

in which ^{xi, vanishes? 

15. Extend Exs. 1 and 6 , § 8 , to functions of several variables. 

16. Extend Theorem 1 , § 9, to functions of several variables. 

17. The same for Theorem 3, § 9. 

18. Theorem 2 , § 9, can he generalized as follows. Let 
***»<^w) he continuous in a connected region of n-dimensional 

space. I-.et it be positive at one interior point of the region, and 
negative at another. Then the function has a root in the region. 

19. Generalize Exercise 6, § 9. 

20. Generalize Exercise 7, § 9. 

21. Uniform Continuity. A function f • • •, defined in 
the points of a point set is said to tlie uniformly continuous 
there if to an arbitrary € > 0 corresponds a > 0 independent of 
(x) and such that 

where (x') is any point of A and (x) is any point of A within the 
^-neighborhood of (x'). 

State and prove tlie generalization of the Theorem of § 10 for 
this case. 

22 . If a function /^(xj, • • x,i) is uniformly continuous in an 
open region, R, and if 7^ is a boundary point of 71, show that the 
function approaches a limit when (x) approaches 7^, always remain¬ 
ing in H. Assujne only such boundaries as are analogous to the 
surface of a ]K>lyhedron in space, or a simple regular curve in the 
plane, Chap. VII, ^10. Begin with the case n = 2. 

25. If the definition of the function in Question 22 be sup¬ 
plemented by setting it equal in each boundary point to the limit 
which it approaches there, show that the extended function is con¬ 
tinuous in the closed region. 

24. If y(xi, • • •,x„) is defined in the points of a closed set. 
Ay and is positive, show that there is a point of Ay in every neigh¬ 
borhood of whic h the function conies arbitrarily near its lower limit. 

25. Covering Theorem. Extend the Covering Theorem to a 
closed set in space of n dimensions, and prove it. 
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Derivatives. Intej^als. Implicit Functions 


§ 1. Derivatives. Let a function f (x) be defined in the neigh* 
borhood of a point, x = Xq. Form the difference-quotient: 

n /(Jq + Ax) - /(Xg) 


where Xq + Aj: is a point of the above neighborhood, distinct from 
Xy. If the quotient approaches a limit as Ax approaches 0, the 
function is said to have a derivatwe^ or be differentiable^ at the 
point Xq. We write: 

2 ) lirn _ 

Ax 


If the ratio 1) approaches a limit when A.r approaches 0 passing 
only through positive values, f{x) is said to have a forward deriv¬ 
ative, And similarly for a backward derivative. If, and only if, 
these two are equal, will f{x) have a derivative in the point xq. 
But if Xq is an end point of the domain of definition of f{x)^ then 
f{x) is said to have a derivative in the point Xq if the forward or 
backward derivative exists. 

If a function has a derivative in a jwint, the function is continuous 
in the point. But the converse is not true, as will presently be shown. 

If the difference-quotient 1) becomes infinite as Ax approaches 
0, the function is said to have an infinite derivative. In particular, 
we may have 


lim = + oo 


and similarly for lirn Ax = 0”". When, however, we say of a func¬ 
tion that it has a derivative^ we shall use the word only in the 
sense of a proper derivative, and exclude the case that the difference- 
quotient becomes infinite. 

If f{,x) has a derivative at eveiy point of an interval, oper^ or 
not, the function is said to be differentiable in the interval. 
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Example 1 . The function 

:=z \x\^ — 00 <<X<C OO, 

is continuous for all values of x. It 
has a derivative when x ^ 0. In the 
point = 0 it has a forward derivative, 
the value of which is -f 1 ; and a back¬ 
ward derivative with the value — 1 . 

Since + 1 ^ — 1 , the function has no 
derivative at the origin. 

Example 2 . If, however, we take as the domain of definition 
the interval 

0 ^ or <C + oo, 

or, again, the interval 

— CO < x ^ 0, 

the function 

r = 1X1 

has, in each case, a derivative at eveiy point. 



1 . If a function has a forward derivative at a point, and also 
a backw^ard derivative at the point, sliow that it is continuous at the 
point. 

2» Show that the function* 

_ /(O) = 0 

• A^airi we p(»irit out that we arc using the elementary functions only for 
the coiIV(Milcure of illustration. The examples could be constructed without 
them. The theory is in no wise dependent on them. The elementary f\mc- 
tions will presently be developed systematically. 



DERIVATIVES. INTEGRAlii. IMPLICIT FUNCTIONS 99 


IS continuous tor all values ot‘ .r, but that, at the point x = 0, it 
has no derivative. 

3. ff each ot* two lunctions. f{x) and (p{x), has a derivative at 
the point .r = a, show that each of the functions 

f{x) + tp[x), fix) <pix) 

has a derivative there, also. And the same is true of the function 

ip{xy 

provided if {a) ^ 0. 

Give an explicit reference to each theorem you use in the proof. 

4. Show that the function 


y — X 

has a derivative for all values of x. 

5. The same for 

y = c, 

where c is a constant. 

6 . Prove; 

= nx^-\ 

where n is a natural number. 

7. Show that a polynomial: 

G{x) = ^ + • • • + 

has a derivative. 

8 . Show that a rational function: 




where G{x), F{x) are polynomials, in general has a derivative. 
What are the exceptions? 

Are (r{x), F{x) any two polynomials? Answer explicitly. 

9. If the lunction 

xfix) 

has a derivative at a given point, Xq ^ 0, and if f{x) is continuous 
there, show that f{x) has a derivative there. 

10. In Questions 3/9 an €-proof was required in three cases. 
What were they ? 
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§2. Continuous Function without a Derivative. Con¬ 
sider the function 

1 


( /(x) = xao—, 

I /(O) = 0. 

It is continuous at the origin, but it has no derivative there. For, 


I /(0) = 

[t is continuous at the origii 

/(Tq +-Ax) -/(Xg) _ jJn—L_ 

Ax Ax 

and this variable approaches no limit, 
but oscillates between + 1 and — 1 
,as Ax approaches 0. 

On the other hand, the function 


2 ) 


{ 



f{x) 3= sin — , x ^ 0; 

JIT 

/(O) = 0 

has a derivative at the origin, since 
/(^o.±.4£).-/.(^o) = Ax rin-L, 

dkX 

and this \ariab1e approaches the limit 0. 
Observe, however, that 

tan r — Dty =/'(x) 
is not a continuous function. For, 

/' (a:) = 2 a: sin -cos ~, 

X X 




0 , 


and when x approaches 0, this function approaches no limit. The 
explanation is simple, when one looks at the graph. For, as a point 
P moves along the curve, approaching the origin, the tangent oscil¬ 
lates and approaches no limit — why should it? Nevertheless, the 
curve has a tangent at the origin. 

The hmction 

4 1 

fix) = x^sin —, 

/{ 0 ) = 0 




5) 


3 c ¥‘0 ; 
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has a derivative for all values of x, but the derivative does not remain 
finite at the origin. Its value at the origin is 0. 

It is easy to form an example of a continuous function which 
fails to have a derivative in the points of a set everywhere dense; 
Weierstrass* was the first to give an example of a continuous func¬ 
tion which nowhere has a derivative. An example simpler to follow 
in detail has recently been given by Perkins.** 

§3. Rolle’s Theorem. [jet ^{x) be continuous in the closed 
interval 

and let 

ip {a) = 0, ip {h) = 0. 

Let ip{x) have a derivative at the interior points^ 

a <. X <. b. 

Then the derivative vanishes at an interior point: 

9 '(X) = 0, a < X < b. 



Proof. If ip{x)^-^Q, the truth of the theorem is obvious. In 
all other cases the function will take on positive or negative values, 
or both. Hence the function will have a maximum or a minimum 
inside the interval; Chap. Ill, §9, Theorem 3. Suppose it has a 
maximum at a: = X. I'hen 

ip{X + h) g ip{X) 

for all values of h numerically small. Thus 

4p{X + h)-<p{.X) f ^ 0, 0 < A; 

h Iso. A < 0. 


• Cf. C. Wiener, Journ. fur Math. voL 90 (18811 p. 221. 

•• P. W. Perkins, Amer. Math. Monthlx voL 54 (1927) p. 476. 
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Since ip (ar) by hypothesis has a derivative at a: = X, this difference- 
quotient must approach a limit ais h approaches 0. The forward 
derivative is ^ 0; the backward derivative is ^ 0. Hence the 
derivative is 0, q. e. d. 

The importance of this theorem lies in the fact that its proof is 
purely arithmetic^ not based on geometric intuition, but solely on 
the theory here developed analytically. 

§4. Law of the Mean. Let fix) he a function continuous 
in the closed interval a ^ x and let it have a derivative at 

each interior point: a <, x <. h. Then 

f{h) -/(«) = - a)fiX\ a < X < h‘, 

fia + h) =/'U) + hfia + Bh\ 0 < 0 < 1. 

Proof Form the function: 

«p{,x) = {x- a) [f{b) -/(a)] - {b - a) [/(«)-/(«)]. 

This function satisfies all the conditions of Rollers Theorem. Hence 
its derivative, 

=fib) -fia) -ib- a) fix), 
must vanish within the interval: 


)fib>-fia) 


f'(X) ^fih) -fia) -ib- a)fiX) = 0, a< X <b. 
From this equation the theorem follows at once. 

Again, a theorem the truth of which is, geometrically, intuitively 
obvious — for must not a tangent 
be parallel to the secant, or 

— has been proved arithmeticaUr 
with the analytic means here at 
our disposal. 

As a first application consider 
the theorem that a function fix) 

whose derivative vanishes identicaUy^ is a constant. Let x and a 
be two points such that the closed interval (n, x) lies in the domain 
of definition. Then 



/(*) - /(«) = (*-«) f (.y) = 0- 
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A corollary of this theorem is the fact that if two functions^ 
,f{x) and ip{x\ have the same derivative^ 

they differ by a constant: 

fix) = f(x) + c. 

§5. Differentiation of Composite Functions. Differ* 
entials. I^et 

« =f(y) 

be a function of y^ defined in the neighborhood of the point y ^ y^ 
and having a derivative in that neighborhood. liCt 

r = <p U) 

be a function of x^ defined in the neighborhood of the point x ^ x^ 
and having a derivative in that point. Finally, let 

f Uo) = Jo- 

I’hen iz, regarded as a function of xi 

“ w]. 

has a derivative in the point x = Xq, and 

DxU = DyU Dxy. 

For, let 

^y — ip {xq + Ax) — ip (xo), 

where | Ax | < h and h is so chosen i) that the points 

I X — xo 1 < 

lie in the second neighborhood and ii) that the point y^ -h Ay lies 
in the first neighborhood. Then, by the Law of the Mean, 

Am =/(jo + ^y) -fiyo) =f'(yo + ^aj) aj. 

Hence 

When Ax approaches 0 , the right hand side approaches a limit, 
provided that /' {y) is continuous; 

lira /'(Jo + 9 Aj) = lim /'(jo + fl Aj) lim 

Ax .\7-~0 ^9^ Ax 

This proves the theorem under the restriction mentioned. 
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The proof given in the elementary treatment of the Calculus by 
writing 

An _ An Ay 
Aj? Ay Aj: 

is not general, since Ay may vanish for values of Ax ^ 0 in every 
neighborhood of the point Ax == 0. For example, 

*p (x) = c, 

where c is a constant. Here, Ay^O, and so for no value of Ax 
can we divide by Ay. 

It is possible to meet the difficulty and establish the theorem 
without any restriction. Let 

= fSro.+Ap-f(ro), Aj ^ 0; 

Ay 

t(o)=/(ro)- 


Then the equation: 


— f Ay) - 

Ax Ax 


is true for all values of Ax considered. Now, the function >|^(y) is 
continuous at the point y = 0. Hence the right hand side of this 
equation approaches a limit: 

lim f =f’{Yo) ^{xq). 


and the proof is now complete. 

Differentials, It is to the theorem just proved that the differ¬ 
entials, regarded as an aid to differentiation, owe their value. For, 
by definition, 

dy = Dxy Ax, 

when X is the independent variable. Moreover, when x is the in¬ 
dependent variable, we define dx as equal to Ax: 


Hence 


dx = Ax. 
dy = Dxy dx. 


when X is the independent variable. And now, by the theorem just 
proved, it follows that this equation is true when x and y are both 
functions of* t : 




* = f (0- 
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For, D,y ~ DxX DtX, 

tand by definition : 

cfy = D/y dx ^ DtX £^t, 

§6. Taylor^s Theorem with a Remainder. Let f{x) he 
continuous in the closed interval 

a X ^ h 

Let f{x) have derivatives of the first n 4* 1 orders^ 
fix), f"{x), •••, f”*^{x), 

at all interior points of the interval t a <, x <, h. Then 

/(Xo + h) —/kx^) + hf'ixu) + + • • • + 

zi n\ 

+ (xo + 9h), 0 < 9 < 1, 

where Xq, Xq h are any two points of the interval. 

The proof is given in the Calculus; cf. for example the Author’* 
Introduction to the Calculus^ p. 431. 

§7. Functions of Several Variables. Let 

be a function defined in the points of an open region R in the n-dimen- 
sional space of the variables • • •, :rn). The concepts : convergence^ 
limit, continuity have already been defined, Chap. Ill, end, Exercises 
2/8, pp. 94/95. The partial derivatives of u at the points of R are 
defined in the usual manner; e. g. 



If u=^f{x,y\ 

we shall write the derivative in either one of the rotations: 



or 




etc. 
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The proof that 

u _ d^u 
dx dy dy dx 

under suitable restrictions — the existence and continuity of fx (x, y\ 
fy Jk)i fxy (^» y) is sufficient — will be given in Chap. IX, § 6. 

If there is only one independent variable, n = 1, the derivative 
becomes an ordinary, or total derivative; 

du 

dt' 

But it would be inconvenient to make an exception in this case, and 
so we write 

du 

dt 

when occasion arises. 

haw of the Mean, Let the function f (x^, • • •, Xn) be defined 
in the region 

'A: I — a* 1 < /f*, A =1, •••,!«, 

and let it have partial derivatives of the first order there. Let 

\hk \ < A: = 1, • • •, n. 

Then the difference 

/(«i + *1. • • •, a„ + h„) —/(«i, • • an) 
can be written in the form: 

/(«! + *1, 02 + *2, • •', «» + hn) —/(«]. 02 + * 2 . ' * •» On + *n) 

+ /(oj, fl, + A*. • • •. On + An) — /(oi, Oj, Oj + Aa, • • •, o„ + An) 


+ /(«!. • • •. «n + An) —/(oi, • • On-I, On). 

Applying the law of the mean for functions of a single yariable 
to each of these differences we arrive at a first form of the Law oif 
the Mean for functions of several variables: 

1) /(oi + Ai, • • •, o„ + An) • • •, On) 

n 

^ 2 ‘ • * * * + Aw)* 

0 < Ok < 1. 
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From this result we infer, as a first application, that if the 
partial derivatives are bounded in the point (a), the function is con¬ 
tinuous there. But the theorem would not be true without the 
restriction, as appears frojii the example: 

( fix,y) = , . (x, j) ^ (0, 0); 

2) \ ^ + y- 

<• /(0,0) = 0. 

With the aid of the Law of the Meiin the theorem relating to 
Change of Variables (Theorem 1) is established, and by means of it 
in turn a more symmetric form of the Law of the Mean is obtained 
in case the partial derivatives are continuous in R. Let 

F{t)=f{ai + thi,---,a„ + th„), 0 ^ t ^ 1. 

Apply the law of the mean to F{t): 

F{\) - F(0) 0 < ^ < 1. 

Hence 

5) /(«! + hi, + h„) —/(« 1 , • • •, a„) 

n 

— S /* ® *1- • + 9 h„), 0 < 9 < 1. 

k~l 

In this lorin the law is easily remembered. It holds for more 
general regions. Let 5* be a region which contains in its interior 
the points of the line 

Xk == + t hk, A = 1, • • •, n, 0 ^ ^ 1. 

Then the above proof applies and the theorem is true. 

Thicokkm 1. Changk ov Variables. Let 

he continuous^ together with its partial derivatives of the first order^ 
in the neighborhood of the point {y)^{b); i. e, B: {bi, 

Let 

* * *» 1, •••,/!, 

he continuous, together with its partial derivatives of the first order, 
in the neighborhood of the point {x) = {a); and let 

* * ** = bk<, A = 1, * • •. n. 

Im 




Ar = 1, •• •,/!, 
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be siibstituted in the function fiyi, u thus becoming a 

function of (xj, • • •, arm). Then 

^ dxr dyi dxr ^ dyn 

It is of fundamental importance to observe, in this last formula, 
what the independent variables are. There are two classes : 

Class A, the (ari, • • •, ; 

Class S, the {y^, • • ‘,^n). 

Those partial derivatives in which an Xr appears below the line, assume 
a function of the variables of Class A ; those in which a yj^ appears 
below the line, assume a function of the variables of Class B. 

The student will do well to illumine this last formula, writing 
each Xr, say, in red ink, and each yj in blue. 

For the proof of the theorem the student is referred to treatises 
on the Calculus; cf. e. g. the Author’s Advanced^ Calculus^ Chap. V. 

Differentials, Let 

“ ar») 

be defined in the above region il and possess partial derivatives of 
the first order there. Let (x) and (x + Ax) = (xi -f Axi, • • •, 
Xn + Axh) be any two points of the region. Then 

Au =/(xi + A^i, • • •, x„ + Ax„) -f(xi, • • •, x„) 

can be written by the Law of the Mean, 1), in the form: 

5) Am =/i Axj -f • • • + Ax„, 

where denotes the value of formed for the mean point of that 
formula. 

If, in particular, the derivatives (xj, • • •, x„) are continuous 
in R, set _ 

fk ==/* + Cife* A: = 1, • • •, 71, 
where fj^ is formed for the point (x). Thus 

6) Am = Axi -f • • • + Ax„ 

+ Cl Axi -h • • • + Cfi 

The first line on the right is called the principal part of the 
infinitesimal An and is defined as the differential of m: 
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7) 


dll 


du 

dxi 


+ 


-f 


du 

dxn 


Ax„. 


The differential of each of the independent variables j:* is defined 
as the increment, 

dxi^ = Axf,, A- == 1, • • •, n. 

Thus 7) becomes: 


8 ) 


du = dxi -f • 
vx^ 


, du , 

+ -a— 
OXfi 


And now the fundamental theorem about differentials is, that 8) is 
true, no matter what the independent variables may be. 

More explicitly, consider the change of variables defined above, 
the notation being that of 'Vheorem 1. Then 


9) 



the yoi being the independent variables. Secondly, 


10) 




ftl o 


r=l 


dXr 


the Xr being the independent variables. Now, when the Xr are the 
independent variables, 


11) 


m o 

du^'^ -I-' dx 


n 


By Theorem 1, 


du 

dxr 


dxr • 


Z Z 

r=l awl 


du 

dja 


dXr 


dxr> 


The left-hand side of this equation is equal to du as given by 11). 
The right-hand side is equal, by virtue of 10), to du as given by 
9). Hence 9) is true, regardless of whether the independent variables 
are those of Class A or Class B, and that is what we set out to 
prove. The result can be stated as 

Thkorem 2. Differentials, Let 


and let a change of variables: 


A = 1, • • •, w. 
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be made under the conditions stated above. Then 

12) du=--^^djr, j^dyn, 

regardless of whether the independent variables are those of Class A 
or Class B. 

Remark. Since the differentials of the independent variables by 
definition are the same as the increments, they are arbitrary. Hence 
an equation: 

Ai dz\ 4- • • * + dzp = Bi dzy + • • • + dzpj 

where «i, • • •, are the independent variables and Aa^ Bx are any 
functions of (z^, • • •, Zp), leads to the inference that 

Ax = Bx^ (x* = 1, * • •, 

§8. Integral of a Continuous Function. Let/(j?) be a 

function, continuous in the closed interval 

a S X ^ b. 

lyiark the points x ^p/2^, where n is a natural number and p* = 0, 
± 1, ± 2, •••. For a fixed n, those points which lie within the 
interval shall be denoted by: 

a < Xi < X2'** < < b. 

Furthermore, set 

Xq ^ b x^,^i; 

A: = 0, 1, • • •, v; At* = 2 ^ 

Let X* be any point of the interval (a, ^), which lies in the closed 
interval (x*, x*+i): 

Xwi. 

Form the sum:* 

S— 

where p is either of the numbers 0, 1; and ^ is v — 1 or v. When 
a becomes infinite, the sum S approaches a limit, /, and I is defined 
to be the value of the definite integral 

• When there is no point of division within the interval, 5 still is defined 
if p M 0, ^ M 1. For other values of p, ^ let S « 0. 
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/ 


f{x)dx. 


or 


h 


(x) (iar = lira T /(**) Aar*. 

To prove the convergence we proceed as follows. Lei m* 
be the maximum and the 
minimum values o^f(x) 
in the closed interval 
{xj^, ^A+i)' Assume first 
that /‘(j:) > 0 and let Mt 
m be the maximum and ^ 
the minimum oif{x) in 
(«, b)i 


•H— 






Form the sum; 


m ^ f{x) ^ M. 


As n increases, Tn decreases or remains unchanged: 

Tfi ^ 

But ^ 

T„ ^ '^m Ax* ^ m{b — a). 

Hence Tn approaches a limit, Chap. 11, § 5: 

lim Tn = Ii> 

Similarly, the sum 

v-l 

increases with n, or remains constant: 

tn ~ ^if+i; 

v-l 

tn g YMd^xjt ^ M{b-a), 


and 


Hence tn approaches a limit: 

lim tn = /i* 

n=soo 


■Tv b -Tv-fi 

-1-1-H- 
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Moreover, 
and hence 


tn ^ T, 


Finally, 
For, . 


h ^ /i- 

/2 = /l. 


I’ll fn 



(Af* — m*) Axj + Afo Aa?o + AT, Aa:%. 


Since fix), being continuous in the closed interval (a, b), is 
unifonnly continuous, Chap. Ill, § 10, it follows that, to a positive 
( chosen at pleasure, there corresponds a positive S such that 


!/(*)-/(*')! < «. \x-^x'\ < S, x,x' in ia,b). 


If, then, = 2*“" is less than S, the first sum is less than 
€ (^ — a). Hence 

Tn-tn < € (^- tf) + 2M 2”". 

Now 

-^1 ^ 'I'm tn » -fot 

and so 

0 S Ii-h < € (^ - fl) + 2M 2"", 

Hence 

7, = 4. 

Turning now to the sum 5 we see that 

X m* Aa:* ^ X = X 

*=;» A 0 

Since each of the extreme sums approaches the common limit 
/j = /2 = /, it follows that the sum S approaches this same limit. 

It remains to remove the restriction f{x) > 0. Let C be a 
constant such that the function 


ipix)=fix)^-C 

is positive in (/z, h). Form the sums: 

X V (^ 4 ) ^^4 = X ^p)- 

k=p k-=p 


The sum on the left converges when n becomes infinite, as has just 
been shown. The last term on the right approaches a limit. Hence 
the sum coverges here, also. 
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From the method employed in formulating this existence theorem 
follow at once two corollaries. 


CoROLi-ARY 1. Law of the Mean : 

J f{x)dx = {b‘-a)f(X\ a < X < b, 

a 

For, obviously: 


{b — a) m ^ Jf{x)dx g {b-a)M, 

a 


the lower signs holding only when (x) = const. = m ^ M, 


Jf{x)dx = {b-a)Y, 

a 

m < r < A/, 


If we set 


unless f(x) is a constant. Hence the function 

fix) - Y, 

which is continuous in the closed interval {a,b), changes sign there, 
and so has a root, x = X^ within the interval, Chap. Ill, § 9, 
Theorem 2. — In the excepted case, X may have any value within 
the interval. 


Corollary 2. If a < c < b, then 



c 

dx = ff{x)dx + 

a 



dx. 


The proof is immediate, thanks to the formulation of the exist¬ 
ence theorem, and may be left to the student. 

We are now in a position to prove the following 
Convergence Theorem. Let f{x) be continuous in the closed 
interval (n, b). Let the interval be divided in any manner into n 
subintervals by the points 


a <, Xi <•*• < Xn^i < b. 


and let Xq S a^ b S Xn; let 

Aar* = a;*+i - or*, ar* S or^ x*+i, x^ in (a, *). 
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Then the sum 

k=»p 

where = 0 or 1 and q ^ n ^ 2 or n — 1, approaches a limit for 
n = oo, provided the hugest ^Xk approaches 0. 

The value of this limit is the value of the definite integral: 

7 k 

X “ / /(^) 


Proof, Consider first the case: jtq = a, Xn = h^ p 0, q n -- 1, 
The general case then follows at once. By Corollaries 2 and 1, 


f f(x)dx='^ f f{x) dx='^ fix I,) Ax*, 


^*+1 


n-1 

*=0 


Hence 




f fix) dx-\ /(x*) Ax = IfiXk) -/(x*)] Ax*. 

^ JtaO ibsO 


n-1 

X 

ik=»o 


Sinc« f (x) is continuous in the closed interval (a, b\ it is uni¬ 
formly continuous, and so 

|/(X*)-/(x;)I < €. lAx*|<^. 

Thus 

h 


f fix)dx — /(x*) Ax* 


< e (6 — a). 


and the theorem is proved. 

On the basis of the Convergence Theorem one may define the 
definite integral as the limit of the more general sum which appears 
in this theorem. In any case, the definite integral is the mark*, 

h 

ffix)dx. 


Its value is the limit approached by the sum in question, and this 
number is represented by the same mark* 
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Extension of the Definition, If 3 < the definite integral 
shall be defined as follows: 

h a 



\i a ^ c ^ bj then, by definition: 

c 

y*/ (x) dx = 0. 

C 

Hitherto we have considered only functions f (a:) defined in every 
point of a closed interval. We now extend the definition to the case 
that, in a finite number of points, the function is not defined or 
discontinuous; being continuous, however, in all other points, and 
bounded in the interval. In particular, the interval may be open at 
one or at both ends, as 

a < X < h\ 

but it must be bounded. The above definition of the definite in¬ 
tegral, and the Convergence Theorem, apply to such functions, with 
the obvious modification that no xj^ can be chosen at a point where 
f{x) is not defined, and that a maximum (minimum) may have to 
be replaced by an upper (lower) limit. 

Indefinite Integral. Let f{x) be continuous in the open or 
closed interval {a, b) and let F {x) be a function whose derivative is 
equal to f (x): 

F' (x) —fix). 

I'hen F{x) is called the indefinite integral of f{x). 

One such function is 

X 

F{x) = Jf{t)dt. 

a 

For, by the Law of the Mean . 


+ ^x) — F{x) = ^f{t)dt = ^x fix +• 6Ax), 


lim fU + Ax) - F(x) = lim y (a; + SAx) = /(x). 
Ax 
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The most general function is (Chap. IV, § 4): 


X 

0= 


dt -f- C» 


Exkrctsks 

Let the functions f (j:), <p {x), etc. be defined in the closed in¬ 
terval a ^ X S with the possible exception of a finite number 
of points. Let them be continuous except at most for a finite number 
of points, at each of which the function may or may not be defined. 
And let the functions be bounded in the interval. 

Prove the following theorems: 


^ cf {x)dx c^ f{x) dx. 


where c is a constant. 


If b If 

2) J*[f{x)+^{x)]dx= J*f{x)dx + J x)dx. 

a a a 

h h 

5) J^f{x)dx < y* \f{x)\dx. 

a a 

1 ^ 1 b 

4) ^[/U) + iP ^ \f{x)\dx^ J 1 SP W I dx. 


X 

F(x)= Jf{t)dt 


is continuous, a 'S x h. 


X 

J* fit)dt=f{x). 


provided f{t) is continuous at t = a:. 


Jfix) dx =fib) -fia). 


7) 
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provided fix) is a function belonging to the class here considered, 
and f(.x) is continuous, a x ^ h. 


8 ) 


^f (^) ^ ix) dx =/(x) <p{x) - ^9 (^)/' (^) dx. 


provided {x), 9 ^ (x) belong to the class of functions here considered, 
and f{x) 9 {x) is continuous, a ^ x ^ b. 


{x)f{x)dx. 


Obtain a generalization of 8) for certain discontinuous functions. 
Suggestion; 

A 

9) / / (*) f' (*) dx = ^ fix) ix) 

a * . 

j9. Imp lirif’ in the Calculus we learn how to 

differentiate an implicit function. Thus if 
1) F(x, y, z) = 0, 





But how do we know that Equation 1) has a solution; i.e. defines a 
function? If, for example, 

F{u, a;) = 

the equation 

F(u, a:) = 0 

is true for or = 0, w = 0; but for no other value of x does it have 
a root. 

Again, if 

F (m, x) = — a^, 

then the equation 

F{jUyX) == 0 

is satisfied by the two single-valued functions: 


11 = ^:, 1/ = — x; 

and in the neighborhood of the origin both functions must be retained, 
to give the complete solution. So, even when the equation 

F(tt, a:) = 0 

has a solution, there is no guarantee that the solution will be given 
by a single^valued function. 
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When I was a student, I learned in Williamson’s Differential 
Calculus (the best seller otjthjayf^^da^) that the envelope of a family 

//(^» «•) = 


of curves, 




is found by differentiating partially with respect to tt: 


LL 

dcL 


= 0 , 


and then eliminating a between the two equations. Thus the family 
of circles: 

have an envelope obtained by differentiating partially : 

— 2 (j: - ft) = 0, 

and then eliminating a: 
or 

r = r, jy = - r. 

But I wondered what would happen if the equation of the family 
were thrown into the equivalent form: 

or in the case of the example: 

x — a = ± 


The rule led to 1 == 0, and that did not seem quite right; but 
it did not disturb Williamson, if indeed *he had ever thought of 
it. Youth is iconoclastic, and the Method of Envelopes was one of 
the Articles of Faith, in those days, to which I could not sub¬ 
scribe. 

The reader will have gathered from these remarks that there is 
real need of an answer to the question: When does the equation 

F (n, x) =5 0 
or 

define a function n of x or x^, • • •, Xn? We proceed to the answer. 
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§10. The Existence Theorem.* Let 

1 ) F{u,x,jr, • ■ ■) 

be a single-valued, continuous function in the neighborhood {A) oj 
the point (uq, xq, 

|m-wo|<^, \x-Xf)\<A, \y — yo\<A,---, fi<A; 

and let 

2) • • •) = 0. 

Let F(u,x,y^ • • •) possess first partial derivatives, and let 
them be continuous, in the above region {A). 

Finally, let 

- 5^1 —FuiMoyXa,yt„'--) ^ 0 . 

OU 1(0) 

Then*the equation: 

3) F{u,x,y,‘’-) = Q 

has the following solution in a certain neighborhood of the point 
(«o.a:o,:ro. • • •)••— 

There exists a function, 

4) u—ip{x,y,'"), 
single-valued and continuous in a region 

\x-- Xq \ < h, \y — XQ\<h,-**, 0 < h S A, 

and having the properties: 

a) f (^o»ro» • • •) = I •'01 < 

b) When tp is substituted for u in F, this function vanishes 
identically: 

5) F[q>{x,y, •••). ••• ] = 0; 

c) The only roots {u,x,y,---) of Equation 5) which lie in 
the region 

\u--Uq \ < \ X — Xq \ < h, 1JK — jTo I < • 

where 0 <, A' ^ A, are those for which 

6 ) u=^ip{x,y,---\ 

* The first proof of the theorem, under narrower hypotheses, is due to 
Cauchy, Turin Memoir of 1851; cf. Exerdces analyse vol. 2 (1841) p. 65. 
In its present formulation the proof was given by Dini, Analisi infinitesimale 
▼oL 1 (1877/78) p. 162. 
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Finally, the function <p{x,y, • • •) has continuous derivatives of 
the first order given by the rule of the Calculus, 

Proof, We will begin with the case that {x, y, •••) reduce to 
a single variable x ; 

7) ^ F{u,x). 

Here, w(* can follow each step by a geometric representation. 
The region {A) is interpreted by the interior of a square with its 
vertices in the four points (mq "ii A, Xq A), Let 

0 < 

Since Fu {u, x) is continuous, it is possible to find a subregion {A*): 

! M — z/q I ^ A\ \ X -- xq\ ^ A\ 0 < A^ < A, 
in which 

8 ) 0 < Fu{u,x), 

And now consider the func¬ 
tion 7) along the line x Xq: 

9 ) F{u,Xo). 

This is a function of the single 
argument, u, which vanishes for 
u = Uq and has a positive deriva¬ 
tive when 

Wo + A', 

Hence 

10) 0 < F{uo + A\xq), F(mo —To) < 0. 

Secondly, c.onsider the function of x: 

F (uo -b A', x). 

For T = To it is positive, and since it is continuous, it must remain 
positive in a certain neighborhood of this point: 

11) 0 < F(mo + ^',t) 

when 

To — Aj < T < To + Ai, 0 < Ai ^ A\ 

Similarly, 

12) F(mo - A\ t) < 0 

when To — A 2 < T < To -b A 2 , 0 < A 2 ^ 

Let A denote the smaller of the two numbers Ai, h^. 






DERIVATIVES. INTEGRALS. IMPLICIT FUNCTIONS 121 


It is now easy to give the proof of the existence of a solution of 
the equation 

13) FCm, ^) = 0, 

for which XQ-‘h<x<XQArh and Uq — <. u < Mq 4- A\ 

Let X = x^ he chosen arbitrarily in the interval 

14) xq — h < X <, Xq + h. 

Consider the function F{u^x) for this value: 

F{u, £). 

We have here a function of the single variable u : 

Uq-- A' ^ M ^ I/O + 

which is negative when A^ and is positive for m = z/q + A\ 

Since it is continuous, it must vanish in this interval. Moreover, it 
cannot vsinish but once. For, if it had two roots, w' < u", then by 
Rolle’s Theorem 

Fu(f/,:c') = 0, v! < U < u". 

But this is in contradiction of 8 ). 

We have thus established the existence of a root ii of Equation 
13) for each x of the interval 14), and 

i/q — < u < Uq + A' 

Moreover, we have shown that there is only one such root. Thus 

we are led to a function 

16) i/ = f>(a:), 

defined in the interval 14), single-valued, and such that 

16) A' < ^ (x) < Mo 4“ A', 

And this function satisfies Equation 13). 

This completes the proof of the Exi stence Theore 0 it,.jt, remains 
to establish the continuity of ^{x) and the existence of a derivative. 

The next step, then, consists in showing that ^ (x) is continuous. 
First, it surely is continuous at the point x = Xq: 

\f{x)-f{xo)\ < €, Ix-Xol < #. 

•For A^ can be chosen as small as we wish and hence, if € is less 
than the above A\ a new ^4' = € can be selected. 
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Secondly, let x' be an arbitrary value of x in 14), and let 
li ip Tnen all of the hypotheses of the Existence Theorem 
are fulfilled in the neighborhood of the point {u\x'). In particular, 
then, the solution must be continuous at the one point, x = x\ But 
the solution is unique, and so coincides with the function 15) near 
this point. This completes the proof of continuity of the function 
^(x). 

Remark, Up to the present we have made no use of the hy¬ 
pothesis of the existence of the partial derivative dF/dx\ nor have 
we used the continuity of dF/duy except to justity 8). It is enough, 
then, to assume the existence of this latter derivative, and the 
inequality 8). 

Differentiation, The proof of the existence of a derivative of 
the function ip (:r) is the same as is given in the Calculus. It is 
enough to consider the point x = Xq, VVe have, by the Law of the 
Mean : 

F (uq -H Aw, Xq + Ax) = Aw Fu (uq -f ^Aw, x^^ 4* OAx) 

•f Ax Fx (i^o + ^Aw, Xq + OAx) = 0, 

All _ __ Fx (wq 4- BAu, Xq 4- OAx) 

Ax Fu (uq 4“ OAUy Xq -f dAx)' 

The division is possible for values of Ax suitably restricted, since 
the corresponding values of Aw are also numerically small, and 
FuiuyX) is continuous and different from 0 at {uq^Xq), Hence 

Urn ^0^ 

Jur=o Ax Fu{uo,Xo) 

Exercises 

1 . Carry through the proof in the next case, 

F(w, Xy y) = 0. 

First, write out the theorem in detail for this case. Illustrate the 
region {A) by a cube with its vertices in the eight points (wq d: Ay 
Xq ± Ay Xq ± A). Draw the space figure with ruler and pencil or 
pen. Draw in the smaller cube ( 1^) in less prominent lines. Then 
put in the region 

I M — Mo I ^ I X — xo I < A, \ y — yo \ < It 
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in red pencil or ink, or other colored lines that will make it stand 
out. 

2. Insert at each point of the proof carried through in the text 
a precise reference to the theorem used, and make a list of all such 
theorems, which have been illustrated by the present applications. 

3. Show that the equation 

+ 2m + e = cos (X — jy + m) 

defines a single-valued function 

u=^ip{x, y), 

continuous for all values of the arguments, x and y\ 

4. Give an analytic proof of the theorem in the general case, 
observing the geometric significance of each step in space of n 
dimensions. 

5. Assuming that the function F{u, x^ y^ • ■ •) has continuous 
derivatives of the second order, and satisfies the other conditions of 
the theorem, prove that the function ip(x^ y, * • •) has continuous 
derivatives of the second order. Generalize. 

6. Show that, under the conditions of the theorem, there exists 

a subregion , 

Ri j m Mq I \ X — Xq \ 

and a positive constant such that, if 

F(mi, xi) ^ 0, (wi, x{) in R, 

the equation 

F{u, x) = 0 

admits a solution 

U=tp{x\ Xi) 

defined throughout the interval 

— h' < X — Xi < h’, 

and having the properties of the function <p{x) of the theorem. 

§11. Simultaneous Systems of Equations. Let 

1 ) Fi (i<i, • • •, Up\ .rj, • • •, x„), i = 1, • • •, p, 

together with its first partial derivatives^ be continuous in the 
neighborhood of the point (&i, •••, bp\ ai, • • *, Mn) vanish there: 

Fii,bi^ * * *» ^p\ * * •» Of^ 0 , 
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Let the Jacobian^ 

Ml ... 

dui dup 

/= . 

dFp dFp 

dui dup 

he different from 0 there: 

J • * *, hp\ * * * > ^n) ^ 0. 

Then there exist p fimctions: 

3) Ui = 4pi {xi, • • Xn), i = 1, • • /7, 

continuous in the neighborhood of the point , a„) and taking 

on the value hi there : 

hi = ipi an), i = 1, • • p; 

and such that, when substituted in the functions Fu they cause 
these to vanish identically: 

• - .arn),- • ar„) ; Xj,- • a:„] “ 0, i = 1,- • - .p. 

Furthermore^ the only roots of the simultaneous system of 
equations 

4) Fi {ui, • • •, Xi, • • ',Xn) = 0, i—\,--,p, 

which lie in the neighborhood of ibi, • • •,hp\ a^, • • •, an) are those 
given by Equation 3). 

Finally, the functions (arj, • • .r„) possess continuous deriva¬ 

tives of the first order, given by the ordinary rules of the Calculus, 

Consider the simplest case: p = 2, n = 1 : 

5) F(u,v,x)=^0, ^iu,v,x)=: 0 ; 

BF BF^ 

Bu Bv 

/ = 

B^ B^ 

Bu Bv 

and denote the point by {uq,vq,Xq), We wish to show that the 
simultaneous solutions of Eqs. 5), which lie in the neighborhood of 
this point, are ^ven by two functions, 

6 ) M = ( x ), V == {x). 


^ 0 , 
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each continuous in the neighborhood of x = Xq and taking on the 
respective values Uq^ Vq in this point. 

The functions Fu and Fv cannot both vanish in the point 
lor otherwise J would vanish there. Let 

7) Fu(uo,vo,Xq) 7^ 0. 

Then the equation 

8 ) F{u,v,x)^0 

can be solved for u by the Existence Theorem of § 10 : 

9) M = 05 {v, x ), 

and moreover all the roots of 8) which lie in this neighborhood are 
given by 9). I’hus Equation 9) is equivalent to the first equation 5) 
in the sense that the two equations: 

F (u^V, x) ^ Oy M = 05 (Vy x) 

have the same roots in the neighborhood of {uQy VQy Xq). 

From this fact it appears that the roots of the simultaneous 
system 5) coincide with the roots of the simultaneous system ; 


10 ) 

11 

e 

^ {Uy Vy X) = 0. 

A necessary 

condition lor such 

a root is that 

11 ) 

$ [ CO (v, x). 

VyX]==' 0 . 

And conversely, 

any root {v, x) of 

11 ), lying in a suitable neighbor- 

hood of {vQy o-’o). 

will lead to a value of u through 9), lying in the 

neighborhood of 

u = UQy the tripel 

(^)» -^o) being a root of 5). 

It remains, 

then, to solve Equation 11). Let 


G{Vy x)^^[i 

CO {Vy x)y Vy X ]. 

Then 



Gvivy x) = $ 

^oo , ^ 

From 8) 




dco _ 

F„ 


dv 

Fu' 

and hence 




Gp{v, x) 

J 

Fu • 

Thus 
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^o) 


Jjuo, Vq, Xq) 
Fu{uo,Vq.Xo) 


^ 0 , 


and moreover G (v, x) is seen to fulfil all the other conditions of the 
Existence Theorem of § 10. Hence Equation 11) is equivalent to the 
equation 

{x\ 

where \|r(x) is a function continuous in the neighborhood of the 
point X = Xq and taking on the value Vq there. Let 


Then the functions 


^ (:c) = CD [ (:c), X ]. 

M = ^ (:r), v = y^{x) 


fulfill all the conditions of the Existence Theorem we set out to 
prove. 

The extension of the proof to the case ;? = 2, /i = n requires 
no modification. When > 2, the method of mathematical induction 
can be used. The partial derivatives of Fi cannot all be 0. l-.et 


dF^ 

dui 


^ 0 . 


Then the equation 

Fi (wi, • • •, Up', xx, . • x„) = 0 


can be solved for Ux : 

12) Ml = <D(li2, * * *, Up\ Xx, • • *, Xn)- 


This equation, combined with the last — 1 equations 4), is equi¬ 
valent to the original system 4). And now a necessary condition for 
a simultaneous solution of 4) is, that Up\ Xi, • • •, Xn) be a 

solution of the — 1 equations: 

13) F/[<d(m 2, • • *, M;,; Xj, • • Xn), Mg, • • •, M;,; Xx, ' • Xn] — 0, 

i -2, • ••,/?. 

The Jacobian of this system is seen to have the value 


/ 

dFi/dui 

and so does not vanish at the point (^i, •••, bp; ax, •• •, an)* Thus 
all the conditions of the Existence Theorem before us are seen to be 
fulfilled for the system of * 1 equations 13). 
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Conversely, any solution of 13), suitably restricted as to neigh¬ 
borhood, leads through 12) to a solution of the original system 4), 
and this completes the proof. 

Remark, In the foregoing proof we have made no use of the 
derivatives dFi/dxj, Hence these need not exist. They are not 
needed till the next step. 

Differentiation. Returning to the case /? = 2, n = 1 we can 
prove the existence of derivatives as follows. Let 

= (*0 + Ax) — ip (xq). Aw = (xo + Ax) — 'Jf (xj). 

From the law of the mean, 

F{,Uq + Am, Vq + Av, Xq + Ax) = Am Fu + Ai^ Fi, + Ax F, = 0, 
4 (mq + Am, Vq + At;, Xq + Ax) = Am -h At; + Ax = 0, 

where F„, • • •, * • * are formed for mean values of the argu¬ 

ments, as 

F,^(mo 4- OAm, Vq -H OAv, Xq -h ^Ax), etc. 

Since /(mq. Vq, Xq) 7 ^ 0 , it follows that 

Fu Fv 

formed for these values, will not vanish if Ax is suitably restricted. 
Hence 


Am _ _ 

Fx Fv 

Av _ 

Fu Fx 
<bu <bx 

Ax 

F„ Fv 

^v 

Ax 1 

Fu Fv 
<bu <bv 


formed for the above mean values. It is obvious that the right-hand 
sides approach limits as Ax approaches 0, and hence y(x), >^(x) 
possess derivatives given by the ordinary rules of the Calculus. 

§12, The Inverse of a Transformation. I^t a transfor¬ 
mation he given: 

1 ) yi 1 = 1 , 

where (x^, • • •, x,,), together with its derivatives of the first 
order^ is single-valued arid continuous in the neighborhood of the 
point (mj, • • *, an\ and let 

bi =/<Ui, • • •, an), £ = 1, • • •, n. 
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Let the Jacobian; 

2 ) 


• ••.■Tn) 

dixi, 


be different from 0 in this point. Then the equations 1) admit a 
solution of the form: 

3) = i •••,«, 

where ipt {yi, • • •, ynY is single-vaiued and continuous in the neigh- 
borhood of the point (^i, • • • * having continuous derivatives of 
the first order with non-vanishing Jacobian. 

For, form the equations : 

OCnX yx, • • -.yn) • • *, J^n) — yi = 0, 


1 = 1 , 


*, n. 


Identify these functions Ft with the Ft of the theorem of §10, 
where p = n, where Ui is replaced by Xf, and where the former xi is 
replaced by yi. Then all the hypotheses of the former theorem are 
fulfilled, and the conclusion is a proof of the theorem in hand. 

In rase the Janobi^ 2) vanishes, a single-^lu ed continu ous 

inv e nje ^)_may y tilljjossible ; witnessTtH?"example; 

y^2^, x-yi . 

But the derivatives of the inverse functions cannot be conti nuou s. 
For it is a property of Jacobians that* 

Sjui, • • •, Mb) _ d(u,, • • •, Mn) d{yi, • ■ -, y„) 

d{xi, • • •, x„) ■ • •,y„) d{xi, •■•,Xn)' 

and hence, in particular, in the case of the transformation 1): 


B{yu 


•,yn) 




•. arn) _ J 






^ "'^^however, the Jacobian 2) vani shes identically, a single-value^ 
grse is ne vex.Ha<>wiWlf; '"cr ''* “*•— ~~ " — 

Iratical Vaniahinif of the Jacobian. Let /(u, v), 
v) be two functions which, together with their first derivatives, 
are continuous in the neighborhood of a point {uq,Vq), and let their 
Jacobian vanish identically: 


* Gf. Jordan, Cours d^enalxse^ vol 1 (1893) p. 89. 
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d{u, v) 


Then and ^ are connected by a functional relation: 


2 ) O [/ (u, v), <p {u, v)] s 0. 

For, let 

3) * x=f(u,v), x = ^{u,v). 

If fu, fv both vanish identically, then f {u, v) = const, and we are 
through. Assume, then, that 


=/tt («. v) 4= 0. 


Let {uiy Vi) be a point of the above neighborhood, in which 

4) fuiui,vi) ^ 0. 

Then it is possible to solve the first of the equations 3) for u in the 
neighborhood of this point: 

5 ) CO {vy x). 

Let us substitute this value in the second equation 3): 

6 ) y — ^[c0{VyX)y V], 


The function on the right does not depend on v: 


7) 

For, 


dy 

dv 


= 0. 




dv 


dco 


dv 


fu ’ 


and from 1) it follows that 7) is true. Thus 

y = ^{x) 

is true for all values of x and y given by 3), or 
(m, v) ^ 'if [f (m, v) ], 

and that is what we set out to prove. The generalization is im¬ 
mediate :— 
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m 

Theorkm. Let 

8) JTi, i= I,--*, p, 

be continuous^ together with their first derivatives with respect to 
• * * 1 i^ ihe neighborhood of a point (^j, bp \ fli, * • •, a„)f 
and let the Jacobian 



in ail p -{■ n arguments. Then these p functions are connected by 
an identical relation of the form: 

10) 0 (/l, •••,/;,) ^^0. 

More precisely, let 

Ji —fi{u,x), i = 1, • • •, jt?, 

Ci -fi {b, a). 

Let {y, a!) be a suitably chosen point of the above neighborhood, 
arbitrarily near to {b, a) and let 

Ci^fi{y,y). 

Then there exists a function O , yp), continuous tO' 

gether with its first derivatives in the neighborhood of the point 
(y) r= (c') and vanishing there, but having at least one first de¬ 
rivative different from 0 there, and such that 10) is true for 
all (m, x) in the neighborhood of iff, a!). 

Although (jy, y) can be taken arbitrarily near to {b, a) there is 
no reason to assiune that it can be made to coincide with this point. 
Certainly, in the a>rresponding case of analytic functions of several 
^inplex variables, this is not true,* 

A generalisation of the foregoing theorem for the case that the 
matrix of the determinant of the Jacobian 9) is of order less than 
p—• 1 is given in the Funktionentheorie, 1. c. §23. 

Solutio ns in th y I Thp^pnrpmc of §§10-13 

relaw^to^^^’^soTuaohs ItT^a restricted region, the extent of which is not 
given explicitly at the outset, but is contained implicitly in the 
hypotheses of the theorems. Thus the results hold in the small (im 

* Cf. Osgood, Funktionentheorie lIi Chap. 2, § 22. 
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Kleinen). There .ay i^ n o general methods for dealing with these ques¬ 
tions in preassig g^^g lons; i. e. in the large (im Grossen). Never¬ 
theless there is class of cases in which theorems in the 

small, when supplemented by uniform properties and the covering 
theorem of Chap. Ill, § 11, do lead to results in the large. 

Consider, for example, the theorem of § 10. Let us add to the 
hypotheses the requirement that 

'> . »<-i^ 

in {A). Consider a subregion 

{A*) 1 w — Mo 1 = \ X — Xq\ S- A\ 0 < A' < A, 


Let be any interior point of {A^). Then there passes through 

(ui^Xi) a solution of the equation 

2) F(m,x)=:0, 
namely, 

3) M = ^ (x), 

where the curve represented by 3) meets the boundary of {A^) in 
two points, the iunction ^ (r) being single¬ 
valued and continuous in a certain interval 

£l ^ ^ 

where 

xa — A’ ^ £i < $2 ^0 + A\ 

There are obviously eight possibilities illus¬ 
trated in the acconjpan>ing diagram. 

The proof is as follows. According to § 10, Ex. 6 there exists 
a positive constant h^ suc h that, if x^) is a root of 2) lying in 
(/i/'), then a solution of 2) is given by the equation 

4) u (x) 



where Xi — ^ x ^ Xi + hi. 

Thus starting with an arbitrary root (izi, Xj) of 2), which lies inside 
of {A'), we can pnxeed a distance of //] lorward, and also a distance 
of hi backward. If the curve 4) still lies within (A'), we can now 
apply the equation 4) to an end-point of tlie arc already obtained, 
thus continuing the function ^ U ), and then repeat the process. Since 
we make progress each time by a distance hi along the axis of j:, 
after a finite number of steps we must reach the boundary of {A^). 




Chapter V 

Uniform Convergence 

§!• Series of Functions. Consider a series of functions: 

1) Ml (x) 4- Mo W + * • * 

Let each term be continuous in the closed interval 

a X ^ b, 

and let the series converge in each point of the interval. Denote the 
value of the series by f (x); then 

2) f{x) = III (x) + Mo (x) + • • • 

It is natural to think of the limiting function as continuous — 
partly from experience, for the power series we have met in the 
Calculus and used for computation, represent continuous functions; 
partly because the approximation curves, 

3) y = Sn (x), 
where 

4) (x) = Ml (t) -f : • • -f M„ (x), 

are all continuous and so would seem necessarily to approach the 
limiting function 

5 ) 

in the manner indicated in the figure. 



More fully analyzed this assumption consists of two parts: — first, 
that the limiting locus is a continuous curve; and secondly that, if 
this curve be embedded in ever so thin a strip, all the later approxi¬ 
mation curves will come to lie within this strip. 

Both parts of this assumption, however, are wrong, as is shown 
by the foUowing examples. 
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Example 1 . Let .yy, (:r) be defined as suggested by the accom¬ 
panying figure, namely* 

= I — wo:, 0 S x g 

n 

J/j W = 0, — < X ^ \ \ 

n 

Here, 

liin Sn{x) == 0 , 0 < .r ^ 1 ; 

7I=»00 

lim Sn{ 0 ) = 1 . 

n=^ 

Thus we have an example of a convergent series of continuous 
functions w'hirh converges toward a discontinuous function, 

fix) =0, 0 < ^ 1 ; 

/(O) = 1. 

Example 2 . Let be defined as suggested by this figure: 

Sn (a:) = 2 «jr, 0 g ; 

2 n 

Sn ix) = 2 ^ 2 nx, “ < a: g 

2 n n 

W = 0, “ < a: § 1. 

n 

Here, 

lim 5 n W = 0 , 0 g g 1 , 

nssx> 

and the limiting function, 

fix) = 0 , 0 ^ X S 

is continuous. We have, then, it is true, a convergent series of con¬ 
tinuous functions representing a continuous function. But the con- 

• We point out again that not only does an infinite series determine die 
sum of its first n terms, but conversely any variable 5^ bas corresponding to 
it an infinite series for which it is the sum of the first n terms; namely, the 
series: 

W 2 ==J 2 ““^ 1 » l^n = s„--s„^i. 

It is, therefore, immaterial whether we think of the series as given by the 
Un or die sn» 
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vcrgence is not like that represented in the figure of p. 132. If a 
small strip be constructed about the limiting locus, 

y =/W = 0, 0 g X ^ 1, 

the Liter approximation curves, no matter how great n, will fail to 
xemain within this strip. 

If, then, we wish to secure the kind of convergence suggested 
by the figure of p. !32, a further restiiction is needed, and this 
leads us to uniform convergence^ defined in the next paragraph. 

§2. Uniform Convergence. Definition. Let 

1) ui {x) 4 ih (x) + * • • 

be a series whose terms are defined in the points of an arbitrary 
infinite point set, A. The series is said to converge uniformly if, 
to a positive number c chosen at pleasure there corresponds a natural 
number, m, independent of x, such that 

1 Snt {x) — Sn (ar) ) < €, m ^ n, nf 

Here, 

Sn M = Wi W -f • • • + Un (x), 

and X is any point in A. 

Two consequences of the definition are expressed in the follow¬ 
ing theorems. I’he property of a series embodied in either theorem 
might have been chosen as the definition, and then the other 
theorem, and the defmirion actually laid down, would form the two 
complementary theorems. 

Thkorlm 1. A necessary and sufficient condition for the 
uniform convergence of the series \) is that, to a positive number 
€ chosen at pleasure, there correspond a natural number m, indc' 
pendent of x, such that 

I Sm^p W — W I < €, P == 1, 2, 5, • • • . 

If the series 1) converges, let the remainder be denoted by ry, (x ); 

2) f{x) = Sn{x) + r„(x). 

TarOKEM 2. A necessary condition for the uniform convergence 
of the series 1) is that, to a positive number € chosen at pleasure, 
there correspond a natural number m, independent of x, such that 

1 Tn (x) I < C, m ^ /I. 
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If the series 1) converges^ then this condition is conversely 
sufficient. 

The proofs of these theorems are immediate, since the student is 
now thoroughly familiar with what is meat by a necessary condition^ 
and what is meant by a sufficient condition. 

Example', The geometric series 

1 ) + 

converges uniformly in any interval (tf, b) which together with its 
end points lies wUhin the interval (— 1, 1): 

- I < < ^ < 1. 


For, a number h can be found such that 

|«j, |3l < A < 1. 

In the interval 

-h ^ X m h 
the remainder of the series. 


/ X of* 

rnW = z — 

obviously satisfies the inequality: 

I X;, I < hr . 

I 1—0:1 1—^ 

Now, choose m so that 


Then 

I Tn (x) 1 < €, m S n, q. e. d. 

Observe, however, that the series 1) does not converge uniformly 
in the interval 

2) - 1 < o: < 1. 

If it did; i.e. if 

I Sw (x) - ^(x) I < «, m g n, 

then it would follow, on tetting — n •¥ 1» that 
I x” I < c, m IS n. 
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But m cannot be so chosen that 

I X'" I < e 

for all points of the interval 2), since 

lim x™ = 1. 

^1— 

The series 1) does, however, converge absolutely in the interval 
2). We see, then, that absolute convergence does not insure uniform 
convergence. 

Exekckf. 

Show that the series 

(1 - x) + (x2 - + Cr* - + . .. 

converges absolutely in the closed interval 

0 ^ a: ^ 1. 

Observe that the terms are all ^ 0. 

Prove that the series converges uniformly in an arbitrary interval 
0 g X S A, 0 < /i < 1 ; 

but that it does not converge uniformly in the interval 0 ^ a: = 1, 
Plot accurately the first four approximation curves, using different 
colors — green, yellow, blue, red. Represent the limiting locus by a 
firm, black graph. 

§3. Weierstrass’s Af-Test. A sufficient condition for the 
uniform convergence of a series is the foliovidng. 

The AZ-Test. The series 1) §2: 

converges uniformly in the point set A if a convergent series of 
positive {or zero) constants 

Afi 4-Af2+ •••, 0 S M„, 

can he found such that 

1 Un (x) 1 g A/n, ^ n, 

where p is a number independent of x. 

Proof. From the convergence of the Af-series follows that to 
an arbitrary c > 0 corresponds an m 2s p, such that 

AZn+i + • * • + Afn/ < €, m £ /I, n'. 
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Since 

Sftt W — S„ (x) = lirt+i (x) + Un9 W, 

we see that 

I Snt {x) — (j:) I g I Un^i W | + * * * + 1 (x) | 

= ^/i+l + * • ' + ^nf 

and hence 

1 S„f {x) — (j:) 1 < €, m ^ 71, 7i'. 

This proves the theorem. 

Example. Consider the series 

sin X L sin 2 x ^ sin 3 j: ^ 
l 2 2 ^ ^ 35 + • • •• 

The series 

111 
12 + 2* 32 * 

is known to converge. Set- 



Then the M-Test shows that the series converges uniformly for all 
values of x. 

Exercises 

1. Show that the series 

1 + 4" sin^ ^ ^ sin^ H-, 

2 2*4 

where A: is a positive constant *< 1, converges uniformly for all 
values of ip. 

2. Does the series 

converge uniformly in the interval —I? In the interval 
- 1 < X < 1? Why? 

5. Prove that the series 

o* 

{on CO& nx hn sin nx) 

n^l 

ocnverges umformly for all values of x if the series 
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T y b„ 

nasal nssal 

both converge absolutely. 

4. Show that the series 

MM 

1 + T + — + — + • • • 

2! 3! 

converges uniformly in any bounded interval, but in no unbounded 
interval. 

§ 4. Continuity. Tiii:ori:m, Let the terms of the series 
Ui (x) + Wo (-3^) + • * • 
be continuous in the closed interval 


n ^ X ^ by 

and let the series converge uniformly in this interval. Then the 
function f (x) defined by the series 

fix) = Ml (*) + Zfc (x) + • • • 

is continuous. 

Let Xq be an arbitrary point of the interval. We wish to prove 
that to an € > 0 chosen at pleasure corresponds a i > 0 such that 

1) l/(a?) -fi^o) I < €. 1 X - xo I < f. 


By hypothesis, to an arbitrary c' > 0 corresponds an m indep¬ 
endent of X such that 

2) I Tn (x) I < €, m s 71, 

for all points x of the interval. In particular, then, since 
fix) = 5„(x) + r„(x), 

we see from 2), on setting n ^ m and writing the resulting inequal¬ 
ity first for Xq, then for x, that 

3) l/(^o) - 1 < c'. 

4) Vf{x) - Smic) 1 < c' 


On the other hand, m being now a constant, we infer from the 
continuity of the Unix) the continuity of the sum, 5,/,(x), of a fixed 
number of them. Hence 

6) I Sjn (^) (^o) 1 ^ 


1 X — Xq 1 < S. 
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Combining the inequalities 3), 4), 5) according to Chap, II, § 10 
we obtain the relation: 

6) 1/W — 1 < 3 c', 1 a: - xo 1 < <r. 

If, then, we choose €*, which is at our disposal, equal to J e, the 
relation 6) becomes the relation 1) which we wished to establish#. 

Exercises 

1. Let 

“1 (x) + M2 (x) + • • • 

be a series whose terms are defined in the points of an arbitraury 
infinite point set Af, and let the series converge uniformly in M. Let 
a: = c be a cluster point of M, — regardless of whether c is a point 
of M or not. (In particular, c may be the point oo.) Let each 
term approach a limit as x approaches c: 

lim Un (x) = Un. 

x=c 

Then 

i) The series of limits: 

r/i + f/o + • • • 

converges. 

♦ It is well worth the student's time to study this theorem and its proof 
geometrically, interpreting the condition of uniform convergence: 

Sm W — € < (x) < Sm {x) + € 

as meaning that all the later approximation curves lie in the strip bounded 
by the curves 

y ~ Sm{x) — t, y — Sm {x) + €, 

Then narrow the strip by choosing a new tf ^ e, 
and show eometrically what happens. 

From a geometric appreciation of what is 
going on analytically it is possible to set that 
the limiting locus must be a contiauous curve, 
and then to establish this result rigorously by 
analysis; i.e. by means of the inequalities which 
define continuity and uniform convergence. 

The details are given in the author's Funk- 
tionentheorUy vol. 1, Chap. Ill, § 5; and also in the Bid/. Amer. Math, Soe, ser. 
2, vol. 5, Nov. 1896. 
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converges: 


ii) The function f{x) defined by the series, 
f{x) = Ml (x) + li 2 (x) + • • • 
lirn/(x) = A. 


iii) The limit of the series, namely A% and the series of the 
limits, namely 

are equal, or 

A = B. 

The result can be written compactly in the form: 

lim f{x) = liin Ui (x) lim if> (x) + • * *. 


2. When rn is a natural number. 


( 1 

1 + —) =14-1 + 
m / 

+ ••• 


m , ^ m ' ^ m ' 

1-2 1 - 2-3 

to m -h I terms. 


Prove that 

O + m) 

approaches a limit when m = oo, and that 

lim ( 1 -h — J = 1 + 1 + — + — + • • 
w ooV m/ 21 3! 

3. Let the factors of the infinite product 


fj [ 1 + u„ (ar) ] 

/l=*l 

be continuous in the closed interval a ^ x ^ b. Let the series 

W + ^2 W -h • • • 

satisfy an M-te9t: 

1 u» (x) I ^ Mn, m ^ n\ 

S Mn, convergent. Show that the product represents a continuous 
function, y(x) ; and that 

/(*) = n r 1 + «n w ] iP (•»). 

»aal 

where p is fixed, and ip(x) is continuous and does not vanish. 
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4. 


Prove that the infinite product 



represents a continuous function, f{x\ for all values of x. Show 
that f{x) has its roots in the points x = 0 , ± 1 , ± 2 , • • •, and that 

lim - ^ - — ■ exists and ^ 0 , 

X — n 


n being any integer. 

§ 5. Power Series. Consider the power series 
1 ) ^0 + + ... 

For a particular value of x different from 0, x' 9 ^ 0, let its terms 
be bounded: 

ln„x^"l S G. 

Set 1 x' 1 = X. Then 

\an \ S 


For an arbitrary x such that I x | < X the series 1 ) converges 
absolutely. For 

\a„3*\=z\a„\-\x\’’ ^ g( L|l)" 

The series whose general term is this last expression is a convergent 
geometric series, and the theorem is proved. Let the result be re¬ 
stated as 

Theorrm -1. If the terms of the power series 


and bounded for a particular x' 7 ^ 0 , thfi series converges absolutely 
for all X in the interval 1 x | < \ \, 


A power series may converge for all values of x, like 


or it may diverge for all x 9 ft 0 , like 

x-|-2!x*-|-3!x* + •••• 
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In all other cases the points (or which the series converges constitute 
an interval: 

- R < X < R, 

together with one, both, or neither of the end points. 

For, let £ be a positive number for which the series converges. 
The point set { £ j is bounded, since by hypothesis the series diverges 
for some x = It cannot, tiierefore, converge for a £ >- \ x^^ 
because of Tiieorem 1. 

Let R be the upper linit of the point set j £ i* Then this is 
the R of the theorem. We will formulate the result as 

Tin OR! M 2. The domain of convergence of a power series 
which converges for some,, but not all values of x ^ 0, is an 
interval 

- R < X < R, 

to which one or both of the end points may still have to be 
adjoined. 

For the interior points of the interval the series converges abso¬ 
lutely. For the end {X)ints all conceivable beliaviors occur. 

The term “convergent power series” is used by some writers to 
describe a power series which converges for values of x ^ 0. 

Ihe interv^al (— /I,R) of Theorem 2; or in case the power 
series converges lor all values of x, the point set — oo <, x <, c», 
is called the interval of convergence. 

So much for the plain convergence of a [x>wer series. We turn 
now to the question ot uniform convergence. 

TiiroKiM 3. A power series converges uniformly throughout 
any subinterval {a, h) which together with its end points lies within 
the interval of convergence: 

-R<a<b<R. 

For it is possible to choose a positive number h so that 
\al \b\ < h < R. 

In the point x = A the power series will converge absolutely: 

I ^0 1 + i I ^ + I I + • * *, 

a convergent series. If, then, we set 
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!«„!*'• = M„, 

the conditions of the M-tesl will be fulfilled in the interval 

-h ^ X ^ h, 

and so the theorem is proved. 

It has already been pointed out in § 2 that a power series does 
not in general converge uniformly in its interval of convergence. In 
certain caises it may do so, as: 



The terms of a power series are continuous for all values of x. 
It follows, then, by the aid of § 1- and the theorem just proven that 
a power series represents a continuous function tliroughout any sub¬ 
interval (fl, h) of its interval of convergence. This is not the same 
thing as saying that it represents a continuous function throughout 
its whole domain of convergence; but it is true, nevertheless, that 
it does. 


Theorem 4. A power series represents a continuous function 
throughout its whole domain of convergence. 

Let x! be any interior point of the interval of convergence, 
(■— R, R), It is then possible to choose the interval (a, h) so as to 
include xf in its interior. Hence the function defined or represented 
by the power series will be continuous in .r'. But .r' was any 
interior point, and so the theorem is proved for all such points. 

But this is not the complete theorem. Consider, for example, 
the series 


X — 



1 < X ^ 1. 


We have not shown that the function is continuous in the 
point X = 1 of the domain of convergence, nor can we show it by 
the M-test, since the series 


1 



does not converge absolutely. 

In a remarkable paper, on the Binomial Series, Abel supplied 
precisely the proof that is needed here. It depends on a lemma 
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which he introduced and which is of importance in many branches 
of analysis ; cf. § 6. First, however, one last theorem on power 
series. 

Theorem 6, If a power series vanishes identically in the 
neighborhood of the origin, each coefficient-is 0. 

Let 

<20 + ^*1 X + fl 2 + “ * 

be a power series which converges in a certain region, — il < x < R, 
and let it vanish for all values of x for which — A < x < A, 
where 0 < A S JR: 

0 = flo + X + ^2 + • • • 

Set X = 0. Hence = 0. And now 

0 = X + tfo * = X (/ij + X 4- • • *)» 

where this last power series converges, — JR < x < A; Chap. VI^ 
§ 1. It follows, then, that 

0 = aj 4* ^ + * • *f 0 < I X I < A. 

This series represents a continuous function, by Theorem 4. 
Let X approach 0 as its limit. Then 

0 = flj. 

On repreating the reasoning it appears that am = 0, and this 
completes' the proof. 

CoROLi.ARV. If two power series, 

/Zq + X 4- 

Ao + Aj X 4- A 2 x^ 4- • • •, 

have the same value at all points in the neighborhood of the 
origin, then corresponding coefficients are equal: 

an=^bn, n = 0, 1, 2, • ••. 

For, their difference can be represented as a power series, 

(flo - Ao) 4- (tfi — Ai)X 4- (^2 — A 2 ) x^ 4 - . • 

which vanishes identically in the neighborhood of the origin. 
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Exercisrs 

1. If 

flo + 1 2 • 

converges in the interval (— R, R\ show that 
ai 4 - 2 ^ 2 * 2 ^ 5a^x^ + • •• 

converges in the same interval. 

2. If a power series converges in a certain interval and vanishes 
at the origin, but does not vanish identically, show that it has no 
second root in the neigborhood of the origin. 

3. In the older books Theorem 5 was often proved as follows, 
and this proof was copied in the school algebras. Set a; = 0. Hence 
^*0 = 0, and so 

0 = /Zi X 4“ ^2 • • * • 

Divide through by x, thus getting; 

0 = 4- zi2 + • • • • 

Now set X = 0 again; thus ai = 0. And so on. What is wrong 
in this proof? 

4. After the error mentioned in Question 3 wais pointed out, 
the writer of the school algebra modified his proof by saying: “In 
the equation 

0 = «! 4- ^2 ^ 4- • • •, 

let X approach 0 as its limit. Then 0 = What assumption was 

he making here? 

5. Given a power series: 

ao ai X A -. 

If 

{y \ an \ < — , 0 < A, m ^ n, 

n 

show that the series converges when — A < x ■< A. 

6. Show that the power series of Question 5 will converge for 
all values of x if arid only if 

=0. 
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§6. 

Abel’s Lemma/ Let 


1) 

== wi 4" Wo 4- • • 

■ + 

and let 



2) 

II 

Vli 

VII 

ts 

= 1, 2, • • •, n. 

Let 



3) 

AH 

All 

CJ 

w 

All 

tn ^ 0. 

Then 



4) 

CjM ^ Ml + CoMo 4* * • • 

■L fnW/i = 


Proof, Since 

lij — Jj, Mo ^ -^2 ““ ^l» * * *♦ ~ 

we can write: 

€i Ml + €2 1/2 + • * * + Mn = 

€1 Sx + €0 (jo *“ ^l) + • ‘ {Sn — 5 n-l) = 

(€1 — €0) 4 - (€0 -- €3) ^2 + • • • + (^n-i — €„) ^^^1 + 

Multiply the Ar-tb relation 2) through by €;t ““ ^A+i» Ar == 1, 2,• • 
n — 1 ; the n-th by €«, and add. The result is the relation 4) 
which the Lemma calls for. 

Application, Let the iKiwer series 1), § 5 converge lor x = r ^ 0. 
Then it converges imifonnly in the closed inter\'al from a: = 0 to 
jr = r. 

VVe wish to prove that, to an arbitrary € >- 0, corresponds an 
m, independent of x, such that 

5) a,n+p3f^’’\ < t, p-=\,2,---, 

where 0 ^ ^ r or else r ^ x ^ 0. 

From the hypothesis of convergence for x r follows that 

- c' < a„+i r™+‘ + • • • + a„^pX^f < c', ;? = 1, 2,- • • . 

Now choose m* = ^ — J • Then 



Journal fur Mathematik, vol 1 (1826) p. 511. 
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( X \ ^+1 

— j = 1» 

6) - ^ am+l + • • • + am+p x^'^P g 

If, then, we take 0 < c' < c, 5) will follow from 6). 
Thus the proof of Theorem 4, § 5 is now complete. 


Exerctsfs 

1. It can be shown by mathematical induction that 

, . o • t • cos — cos (n + 4)^ 

sin X + sin 2 j: 4- • • * + sin nx =-=— - , 

2 sin 


X ^ 2 k T, 


Prove that the series 


sin X , sin 2x , 

-r+ + 

converges uniformly in any interval {a, b) which together with its 
end points lies within the interval 0 < jr < 2 r. 

2. The same for the series 


where 


Cl sin X ^ C 2 sin 2x + * • *, 

Cl ^ C 2 ^ lim Cn = 0. 


1 


3. Show that 
4- cos X -h cos 2 X + 


, cos nx — cos (n 4- 1) j: 

4- cos n X = --r--—T-— 

2(1— cos x) 


4. What can you say about the uniform convergence of the 


senes 


X cos X , cos 2x , 0 

a) __ + + • • • ? 

b) Cj cos j: + C 2 cos 2 a: + • • • ? 


§7. The Binomial Series. In the noted paper cited in § 6 
Abel discussed the series 

4 \ 41 ,wi(m— 1)21 

1) 1 4-^x4- ——^x^4--*-, 

1*2 

making no assumptions about the function it may represent. 



148 


FUNCTIONS OF REAL VARIABLES 


If m is a natural nu’iiber, the series breaks off with a finite 
number of terms and so converges for all values of x. Its value is, 
by the bincnnial theoremn, 

2) (l+o:)"*. 

For any other value of m the series converges in the interval 

- 1 < X < 1 

and diverges when \x\ > 1. Denote its value by f{m,x): 

5) f{m,x) = 1 + m:r -f 

Give X such a value and hold it fast. Then 

4) /(m + n, x) x)f (n, x\ 

as we will now show. 

Denote the binomiaJ coefficient by m*: 

i:\ _ _ m(m — 1) • • • (m —+ 1) 

5 ) -- 

Then the series that define the factors on the right of 4) can be 
written: 

f (m, a;) = 1 -f ar -f m 2 + • • *; 

y* (/i, a?) = 1 Ui X ru x*^ • • • . 

These series can be multiplied together by the theorem of Chap. 
VII, S 6: 

6) / (m, x)f (n, j;) = 1 4 . (mj + n{) x + (m 2 + mj /ij n^) x- A - 

We wish to identify this latter series with the one for -H n^x): 

7) / (m + 71, x) = I + (m 4- /i)i a: 4- (m 4- n )2 H-. 

This can done expeditiously as follows. Observe that the coef¬ 
ficient of in 6) is a polyno nial Gj^ (m, n) of degree not higher 
than k in each argument. The same is true of the series 7). Now, 
when m and n are natural numbers. Equation 4) is true, because 
of 2): 

8) G*(m,7i) = (m 4- Ti)*. 

Hence 8) is true for all values of m and n by the following theorem. 
An Algebraic Theorem, Let 

«o 4- «i 4- • • • -h tfm 
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be a polynomial whidi vanislies tor m 4 1 distinrt values of the ar¬ 
gument: x = ‘ £/«• I'hen earh roeffident aj^ = 0. 

Suppose the theoiem lulse. l.et he the first coefficient that 
^ 0. It surely will not he Now 

as 4 4 • • * 4 (.r — £,) • • {x — 

Set X “ £o' expression must vanish. lUit no factor 

vanishes, and here is a (contradiction. 

Secondly, let 

c ix,y) — Aq (>-) •r'" + Ai (j) x’"“’ + • • • + {y), 

where 

(j) = y* 4 4 * • * 4 , 

be a polyno nial which vanishes in each point (r, y = ($£, 
where £o» * ’ '* are m 4 I distinct numbers, and likewise 

*Jo» ’111 * * *» *]« ^ ^ distinct 

numbers. H'hen each eoefficient 
i'z'*' = 0. 

For, ijive to r an arbitrary 
value tj/, and hold it last. I'hen 
G(r,.?j;) vanishes for *''i 

Jni- Hence each vanishes: 

(’?;) = 0, A = 0, 1, • • •, m. 

Hold A fast and let rjj run through 
the n 4 1 values rJ^), rji, •• •. Thus we see that each = 0. 
The proot of the relation 4) is now complete. 

The function J" (m, .r) can be evaluated on the bctsis of the 
functional equation 4) and the continuity of the function inherent in 
its expression hv means o( the series. First, a digression 

On the Functional Fjquatinn:'^ 

9) F(.r + j) = F(x)F(k). 

Let 

F (x) , — LO <1 X < oo , 

be a solution. 

• Cauchy treated this and allied functional ecjuitions in the Coiirs d'an/djne 
algebrique of 1821; Chap. 5. 
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i) 


then 


If F{x) vanishes for a angle value of xi, 

F(^o) = 0. 

F(x)sO. 


For, set ^ = aro. Then 

F(j: + j?o) = ^(^o) == 0 

for all values of x. 

ii) Excluding the case just considered, we see that 


For 


0 < F{x)t — oo < < oo. 


iii) Again, excluding Case i), let a; = = 0. Then 

F{0) = F{0f. 

Since F (0) ^ 0, it follows Aat 

10) F{0) = 1. 

Let 

11) F(l) = a. 

Then 

F(2) = F(l)i!’(l) = «* 

F(3) = F(2)F(l) = a», 

and, generally, 

F(OT) = a", m = 0,1,2. •••• 

Next, let X = ^ = . J Then 

F(l) = F(J)F(i), 

Since obviously 

F(xi + X2* *• + Xn) = F {j?i) F (^ 2 ) • • • F {Xn)f 
it follows that 

«) 

That a positive n-th root of any positive number exists — and only 
one such root—*was shown in Chap. I!, $ 10. 
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We now infer that 

13) ^0=-^- 

where m* and n are any two natural numbers. 

Let == — a:. Then 

F(0) = F(x)F(-x), 

Thus we arrive at the result that 

15) l^(l) = a% 
where f is any commensurable number. 

Continuity. Concerning the mntinuity of F (a:) we know 
nothing. We readily see, however, that if F{x) is continuous for 
a single value, x = ^Tq, then F (j:) is continuous for all values of 
X. For, 

F(xo + — F ( xq ) = F(xo) [ F(A) — 1 ]. 

If the left hand side approaches 0 with h for a single Xq, it follows 
that 

lim F(h) = 1. 

At«»0 

Hence the left hand side approaches 0 for an arbitrary Xq. 

The Function f{m,x). Identifying the function y*(ni, x) with 
F(m) we see that 

/(/n,x) = (1 + x)"*, 

or 

16) (1 + j:)'"= 1 4- toj: + r ^ 

for all rational values of m. 

On the other hand the series 16) represents a continuous func¬ 
tion of m for all values of m. For, it converges uniformly in any 
bounded interval, and its terms are continuous. Let M be any posi¬ 
tive constant. Then 

I m(m — 1) (m — <• + 1) . 1 < 

I 1-2---A 1 “ 


M(Af + 1) ••• (M + - 1) 

1-2 •••* 


U1* = M*, 


lm| < M. 
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and the series 

Af j + Afo -K, • * • 

is shown at once to converge. Hencer y‘(m, is continuous in the 
interval (— M, M). 

Let m = m' be any value of m. Then M can be so chosen 
that m! will lie within the interval (— M, M), Hence is 

continuous in the point m\ and the theorem is proved. 

The Function a*. Let a be any positive constant less than 2. Set 

= = 1 . 

Then 

- 1 < a: < 1, 

and this is a value of x such as we have been considering. 

If follows, then, that for such a value of a there is a function 
of m, continuous for all values of m and coinciding with 

for all commensurable values of m. We define d!^ for irrational values 
of m as equal to this function. Thus the function a"*, or is 
single-valued and continuous for all values of the exponent, m or at, 
if 0 < A < 2, 

If A S 2, let 



when m is rational, and since is continuous and positive for all 
values of m, it follows that there exists a function continuous and 
positive for all values of m, and coinciding with a"* when m is 
rational. We define as equal to this function when m is irra¬ 
tional. 

Thus the function a* is defined and continuous for each positive 
value of A. Moreover, 

On the other hand we have found the most general continuous 
solution of the functional equation 9): 

jF(.r) = A', A = F(l); or F{x)^0, 
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The Functions logr, .r”. With the aid of the results just 
obtained, together with the Exercises that follow, it is possible to 
develop systematically the theory of the functions 

log X, x". 

The reader will find in profitable to make this study later. A better 
first approach to these functions, however, is through the integral; 
Chap. VI. 


Exercises 

1. If X is a constant numerically less than unity, show that 

(1 + x'r — 1 X- 

lini ^- = :r - — + -T- ~ * • 

m-=o rn 2 3 

2. If F(x) is a continuous solution of the lunctional equation 
9), show that 

h 

exists. 

3. Show that a continuous solution of the functional equation 
9) has a derivative: 


where 


dx 

h 0 h 


4. Prove that 


li,„(!+-) 

when p. becomes infinite, passing through all real values numerically 
greater than 1. 

5. Assuming the properties of the functions e*, logx, developed 
in Chap. VI, discuss the functional equation: 

F(x + y) ^ F(x) + F{jr). 

Show that its most general continuous solution is: 

F(x) = cx, — oo -< X < oo, 

where c is a constant. 
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§8. Integration of Series. Let a convergent series of con¬ 
tinuous functions he given: 

1 ) /(^) = Ui (x) + ii 2 (x) + • • •, a ^ X ^ h. 


h h h 

^ fi^) dx = ^ Ui (:r) dx 4* ^ u^{x) dx 


Can it be integrated term-by-term? i.e. will 

h h 

2 ) 

t/ 

a a 

be a true equation? 

Let us analyse this question in detail. There are really three 
questions here rolled into one: — 

a) Will the series 

h h 

/• 

5) 


Ui (x) dx -f U 2 (x) dx + 


converge ? 

b) Can the function/’( j:) be integrated? i.e. does 


//w 


dx 


have a meaning? 

c) If the answers to Questions a) and b) are both affirmative, 
will Equation 2) be true? 

Consider the approximation curves, 

5) X = s„ (x), 

where 

s„ (x) = Ui (x) + • • • + u„ (x). 


They are all continuous, and so 




s„ (x) dx 


means the area under the n-th curve. 
Consider the series 3). Let 


^ Uj (x) 4- • • • 4- ^y* Un (x) dx. 


6 ) 
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The series 3) converges if approaches a limit; and conversely. 
Now, 

7) = 

Hence Question a) is the question of whether the area under the 
curve 5) approaches a limit. 



f 


Example, Let 
Sn{x) = 2nhnX, 




in U) = 0, 



The series 1) converges, and 

/W =0, 0 g X S 1. 


The vaJue of is the area of the isosceles triangle, or 

We have not yet said how hn shall vary with n. Suppose, for ex¬ 
ample, that 

i) hn = Then 

n 




2 


and the series 3) diverges. So, naturally, there cannot be any (Ques¬ 
tion of integrating it term-by-term. — Suppose, however, that 


ii) hn=j^n. Now, 






The series 3) converges, and its value is 0. On the other hand the 
integral 4) converges, and its value is 0, too. So here the series 1) 
can be integrated term-by-term. — Lastly, let 
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iii) hn = n. Consequently 

The series 2) converges; but its value, is not equal to the integral 
4), or 0. 

We see, then, that even though each side of equation 2) may 
have a meaning, it does not follow that the equation is true. 

A sufficient condition for integrating a series term-by-term is 
the following. 

Theorem. Let the terms of the series 

“1 W + M2 W + • • • 

be continuous in the closed interval 

a ^ X ^ b, 

and let the series converge uniformly in this interval. Then the 
series can be integrated term-by-term: 

fix) — Ml ix) + M 2 (a:) + • • • ; 


^ fix) dx ^ Ml ix)dx + ^ M 2 (x) dx • • • 

a a a 

Proofs The function f (x) is continuous; Theorem, § 4. So the 
integral 

8 ) J" f{x)dx 

a 

has a meaning. Next, let 

/ ix) = Sn ix) + r„ ix). 


Then, the functions Snix), rnix) being continuous, we have: 

^fix) dx — ^ s„{x)dx = f rnix) dx. 

m m a 

Since the series converges uniformly, 

|r„(x)l < c, m S n. 


Hence 


^ rnix)dx ^ ^ \rn 

m e 


(x) I <£» < (fe — ) € , m S n. 
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It follows, then, that 

A A 


Jf{x)dx-j Sn {x) dx 


< (b — a) €, 


m ^ n. 


la a I 

and so i) the series of integrals converges; and ii) its value is the 
integral of the series, or 8). 


Exercises 

1, Show that a power series can be integrated term-by-term. 
State this theorem precisely. 

2. Prove: 




' ]• »s*< 1. 

3. Prove: 


2 



4. Give a new example of a series of continuous functions which 
does not converge uniformly, and still can be integrated tenn-by- 
temi. 

5. In €-proofs like the above we have hitherto used two c’s — 
the € of our adversar\% and the c' of our own. Throw the proof 
of the Theorem of the text into that form. 

6. Let 

flo + r -f flo ‘ 

be a power series which converges when 0 S x < h, but diverges 
for j: = A. Suppose, however, that the series 

+ «2 — -h • • • 

converges. Show that the former series can be integrated term-by- 
terin in the interval 0 ^ x ^ h. 
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Formulate precisely each item, or detail, in the theorem you are 
asked to prove. 

Example: ^ ^ 

log2 = l-- + --.... 

7. Consider the series of the I'heorem proved in the text. Show 
that the series 


X X 

^ Ui (x) dx 4- M 2 + 


converges uniformly in the interval (fl, h)» 

8 . Does the series for which 
1 


Jji {x) = 


0 ^ :r g 1, 


1 + n:r ’ 

converge uniformly? Can it be integrated term-by-term? 
Plot the first few approximation curves. 

9. The same for 

osxsi. 

10 . Show that the series 

1 . 1 . 1 . ... 
1* + x® 2» + xa 3* + x* ^ 


converges uniformly in the interval 0 
tegrated from 0 to oo ? 


a: < oo. Can it be in- 


11 , It can be shown (cf. Chap. VIII) that the function 

/ N sin a? , sin 2 a; , , sin n a: 

W = —T" + — Z — + • • * + —— 
1)6 n 

is bounded for all values of n and ar. Show that the series 
sin a: , sin 2 a? , 

can be integrated term-by-term throughout any interval. 

12. Prove that the series 

V 2x 

can be integrated tenn-by-term. 
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§9. Differentiation of Series. Ijet a convergent series of 
differentiable functions be given: 

1) / W == Ml (:*:) + ^2 W + • * • » a ^ X, ^ b. 

Can it be differentiated term-by-term? i. e. will 

2) f (j;) = u[ (x) + i4 (x) 4- • • • 
be a true equation? 

This question, like the corresponding one for integration term- 
by-term, consists of three parts: — 

a) Will the series 

3) u[ (x) 4- Mo (x) + • • • 
converge? 

b) Can the function ^ (or) be differentiated? i. e. does 

4) /(xq + Ax) -/(x„) 

Ax 

approach a limit when Ax approaches 0? 

c) In case the answers to Questions a) and b) are both affirma¬ 
tive, will 2) be a true eqution? 

Consider the approximation curves 

5) X = s„ (x), 

where 

Sn (x) = (x) + • • • + M„ (x). 

E^ch one has a tangent at every point, and so 

means the slope of the /i-th approximation curve at the point x = :ro. 
Consider the series 3). Let 

6) S„ (x) = (x) +-h u'„ (x). 

The series 3) converges at a point x = Xq if (xq) approaches a 
limit; and conversely. Now 

7) S„ (x) = s' (x). 

Hence Question a) is the question of whether the slope of the curve 
5) at a point x = Xq approaches a limit. 
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Example, Let* ** 


The series 1) converges and 
/(x)=0. 

The function S„{x) is here: 

At the origin, 


— oo < j: < oo. 



5,(0) = 1, liin5„(0) = l. 

1Vm» 


I'hus the series of the derivatives, 3), converges. The function 
f{x) has a derivative at the point x 0: 

fiO) = 0 . 

But the derivative of the series, namely, /' (0) = 0; and the series 
of the derivatives, namely, 

1 =i4[(0) + 4(0)-f •••, 

are not equal. 

A sufficient condition for differentiating a series term-by-term 
is the following. 

Theorem. Let the terms of the series 
8) ui (x) + wg (^) + • ‘ ’ 

have continuous^* derivatives in the closed interval 


• To plot the curve 

^ ” 1 4-n*jc*’ 

begin with the curve: 


Then make the transformation of similitude, 

n n 

** The restriction of continuity can be removed by meant of a different 
proof, cf. {10. 
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and let the series converge. Let the series of the derivatives, 

9 ) u'i(x) + i4(x) + • • • , 

converge uniformly in the interval. Then the series can be differ- 
entiated term-by-term: 

10) / W = Ui (x) 4- 2^2 W + • * * 

1 1) f (x) = u' (x) + Mj (x) + 

Observe all that the theorem contains. It is first and foremost 
an existence theorem respecting the derivative of f (x). It asserts 
that, at an arbitrary point x — J of the interval, the variable 

12) / {x' + Ax) - / (.rp 

Ajt 


approaches a limit as £^x approaches 0. Finally, it identifies the 
derivative ff (j:) with the value of the term-by-term derivative series. 

Proof. Let 

15) f (x) = (x) + (x) + • • •. 

The function tp (x) is seen to be continuous by § 4. And by § 8 the 
series 15) can be integrated term-by-term: 


14) 



= [ Ui (x) — Ml {xq) ] -F [ Mo (x) — M2 (xq) ] + * * ’ 


By hypothesis, the series 8) converges for x = x©: 

16) /(xo) = Ml (xo) + M2 (xo) + • • • . 


On adding 14) and 15) we find: 


X 

f f{x)dx +/(xo) 
*0 


= (x) + u, (x) + • • • . 


X 

/(x)= J ^(x)<ix+/(xo). 

*9 


Hence 
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The function on the right of this equation has a derivative, since 
d n , 

— I ip{x)dx-ip{x). 

Therefore f (j:) has a derivative, and 

f{x) — ip {x). 

This completes the proof. 

We could have stated and proved a more general theorem, since 
we have used the hypothesis of the convergence of 8) only for a 
single point. If, then, we had demanded that 8)' converge in one 
point, X = Xq, of the interval, our proof would have shown that 8) 
necessarily converges in the whole intervaL 

But this formulation of the theorem would be unfortunate for 
the needs of practice, since in the applications of the theorem one 
always knows in advance that the series 8) converges, and so this 
other formulation, by stating and proving what is known before 
hand, would have distracted attention from the main hypothesis, 
which one must show is fulfilled, namely, the uniform convergence 
0 / 9 ). 

It has turned out that the series 8) converges uniformly. But 
this property would not help in the formulation of a sufficient con¬ 
dition. The series of the above Example converges uniformly, but 
it cannot be differentiated term-by-term. 

Example, A power series can be differentiated term-by-term. Let 

16) no + ^ • 

converge in the interval 

— jR < a: < il. 

Consider the term-by-term derivative series: 

17) ni -f 2^2^ + + • • •. 

Its terms are continuous and it converges in the above interval; §5, 
Exercise 1. 

Let x^ be any point of the interval. It is possible to find a posi¬ 
tive number h such that \x^ \ <. h <. R, In the interval ( — A, A) 
the series 17) converges uniformly. Hence 16) can be differentiated 
term-by-term in the point x'. But or' is any point of the interval. 
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Observe the order of choice: — first, a/; then the interval 
(—A, A). It would not be possible to prove the theorem by applying 
the test to the interval (~ R, R), since a power series does not in 
general converge uniformly in its interval of convergence. 

Remark, The corresponding theorem in the complex domain 
is simpler. If Un {z) is analytic in a two-dimentional region S of the 
complex z-plane, and if the series 

Ml (z) + Mo (r) -f * • • 

converges uniformly in 5, then it defines or represents a function 
f{z\ analytic in 5, and the series can be differentiated term-by-term 
in S. 

ExERcrsr s 

Show that the following series can be differentiated term-by- 
term. 



2 . 


n=l 


1 


{n - xf * 


5. 



n 


]■ 


4. X flogCt +—) — X log (1 + —)]. 

„=iL n n J 

5. Show that the series 

JL _ 1 ^ 1 _ 

a M IT -y/ a 2 t 

converges uniformly in the interval 0 < m < -p oo 

6. Show that the series of Question 5 can be differentiated 
term by term. 

7. If, in Ex. 3, § 4, Un (x) has a continuous derivative and the 
series 

u\ ix) + u^{x) + • • • 
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latifies an M-test, the function f{x) will have a derivative given b; 
the series 

f jx) _ u!,{x) 
f (x) 1 + Unix) 

provided no factor vanishes. 

Complete the theorem for the case that a factor vanishes. 

§ lOe Double Limits and the s (n, m) - Theorem. The 

foregoing cases of the continuity of a series, its integration term-by- 
term, and its differentiation term-by-term, are examples of double 
limits. Thus, for continuity, we start with a convergent series of 
continuous functions: 

/(jr) = (ar) + Uj W + • • • 

and inquire when f{x) will approach a limit as x approaches 
that limit to f{xQ)\ 

1) lim/(ar) =/(xo). 

Now 

/(a?) =5 lim Sn{x), 

7ls=oo 

and so the left hand side of 1) can be written: 

2) lim r lim Sn 1 • 

XtamXQ nwoo J 

On the other hand, the right hand side of 1) can be written at 
5 ) lim I lim s>, {x) 1 

For, Sn (x) is continuous at x = Xq and so 


(xo) = lim Sn (x) ; 

and 

/(^o) = bm Sn (xo). 

nsaaoo 


The question of continuity reduces, then, to the question of 
when the double limits 2) and 3) will be equal, or 
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Again, in integration term-by-term, the question is: When will 
h h 

5) / (lim (x)) i/j: = lim / Sn{x)dx'> 

ty ' noM * TteaM 


Since the definite integral is itself by definition a limit, we have 
here, too, the formulation of the problem in terms of the equality of 
two double limits. 

And, thirdly, in differentiating a series term-by-term. Here, 

6a) f (x) = lim f lim - M^) 1 ^ 

whereas 

6b) u[ (x) -b % W + * • * 


= lim r 

tlBsaen ^ Ax -* 

I hat two double limits are not in general equal, even when 
both exist, has appeared time and again in the foregoing paragraphs. 
But if this is the point to be illustrated, a far simpler example can 
be given. Consider the function 


Here, 


and so 


But 


9 (*. y) = . 0 < T, 0 < y. 

lim <p (x. y) = 5, 


lim lim <f (x, y)j = 5. 


lim (x, y) = 2, 


lim I lim f {x, y)\ = 2. 

4f»0 IjrmxO J 

Thus each of the double limits converges, but their values are 
not the same. 

The short proof given in the older books on the Calculus for 
the theorem : 
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d^u ^ 

Bx By By Bx 


was based on the assumption that, when each of two double limits 
exists, their values are equal. And the same criticism holds for 
applying the rule for determining the limit 


lim 




fM. 

F'(x) 


a second time, when (a) = 0 F' (a) = 0, thus arriving at the 
result: 


lim 


.fM 

FM 


= lim -SM 
*=a F^{x) 


etc. 


It was not until the middle of the last century that this procedure 
was justified by sound proofs. 

The following theorem has a wide range of applications in ques¬ 
tions relating to double limits. It is an outgrowth of the theorem of 
§ 4, Exercise, and it will be convenient to state it first in that 
restricted form. The notation, 5 (rn, n), is so chosen as to suggest the 
sum of the first n terms of a series. 


«i (m) + «2 (m) + • • • , 
whose terms depend on a parameter, m: 

Snim) = Ml (m) + • • • -f M;, (m), 
s (m, n) = Sn (m). 

Tiikokem. Let s{m,7i) be a function of the two natural 
numbers^ m and n, which satisfies the following conditions: 

a) 5 (m, n) approaches a limit when n becomes infinite: 
lim s (m, n) =:f{m). 

nosso 


b) s (m, n) approaches a limit when m becomes infinite : 

lim r (m, n) = Sn* 

nrnm^ 

c) s (m, n) converges uniformly^ when n = oo : 

I s (m, n') — s (m, n) j < €, v ^ n, n\ 


where v does not depend on m. 
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Then: 

i) f (m) approaches a limit, when m = oo: 

litn fim) = A. 

mtssac 

ii) Sn approaches a limit, when ;i = oo • 

lim Sn = B, 

ns=Boo 

iii) ^ 

Or : 

7) lim lim s {m, n) I = lim I lim 5 (m, n) I . 

>71=500 L n=:3a J n=oo L m=oo J 

Proof, In G)ndition c) let m = oo: 

8) 1 — 5„ 1 S €, v g n, n'. 

Hence Sn approaches a limit; denote it by Bi 

lim Sn == B. 

Tlsssao 

In 8) let n' = oo : 

a) 1 fi - I g €, V ^ n. 

In Condition c) let n' = oo-. 

^) |/('n) — i (m,7t) I g €, V ^ n. 

Finally, let p. be so determined that 

y) 1 5v — 5 (m, v) 1 < €, g m. 

On writing a) and fi) for n = v and combining with y) we 
have: 

I B -f(m) i < 3c, ^ m. 

Hence f{m) approaches a limit, A; and A = B, 

Both theorem and proof admit an immediate generalization as 
follows. Let j a: j be an arbitrary point set having a cluster point 
X or extending to -f- oo (a = + oo) or to — oo (« = — oo). 

Similarly, let \x\ b© a point set with y = h cluster point (in 
particular: ^ + oo, — oo). Let s {x, y) be a function defined for 
each point of {} and for each ^ of j } * where x, y are chosen 
arbitrarily and independently. And now the hypothesis is: 
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a) lim s{x,jr) shall exist; denote it by f{x). 

yamb 

b) lim s{x^y) shall exist; denote it by 

c) I i(x.y) - s(a;.^) | < c. {J < [ < !' 

where S is independent of x. 

The conclusion is: 

i) approaches a limit: 

^/(x) = 

ii) ^(y) approaches a limit: 

lim ip (^y) = B. 

ill) A = B, 

Or: 

9) lim I lim s (x^ 1 = lim I lim s (x, y) 1. 

Xssa L y^b J y=ib *- r=:a J 


Remark, From the hypotheses of the theorem it does not follo\s 
that in Condition c) the rdles of m and n can be reversed. It can, 
indeed, be inferred that, to an arbitrary positive €, correspond two 
numbers, p and q, such that 


1 s (m( n') — s (m, n) 1 < • €, 

p rrJ\ 

c 

VII 

If we set n' = /», we get: 



1 5 (m^ n) -- s (m, n) | < €, 

p ^ m, 77i'; 

q n. 

But q depends in general on c. 

A.S an example let 


10) 5(m, 7x) = 

sin {n/m) 
n 



Of course, there is nothing paradoxical in this situation. The 
existence of a two-dimensional limit, as 


11) lim5(m,n), 

(mi/I bb(oc, oo; 

does not in general carry with it the existence of either of the one¬ 
dimensional limits: 

12) lim s (m, n), lim s (m, n). 

ntmso mKsae 


Example: 


s (m, n) = 


sin m 


-f 


sin n 
m 


13) 


n 



UNIF0R>1 CONVERGENCE 


169 


And conversely, the existence of both these one-dimensional limits 
is not enough for the existence of the two-dimensional limit 11): — 


Example: 

14) 


s (m, n) 


n m 


The unitorm condition c), combined with the one-dimensional limit 
122 ), does insure the existence of the two-dimensional limit 11). 

A Further Extension, I^t j x j denote a point set in space of 
n dimensions, and let (a, • • •, ^n) be a cluster point of the points 
(jTi, •••,Xn) of the set. Let }y{ be a point set in space of m 
dimensions, and let (Z>i, •••,Z>m) be a cluster point of the points 
(j^ii * * ■» of this set. In particular, one or more of the a’s may 
he infinite, a^ — 00 , — 00 ^ or 00 ; and similarly for the h\, 

Ijet s (j;, ^) = J (j:i, • * •, • • •, ^n) be defined for each 

point {x) of jj:} and for each of \y\^ where (x) and {y) are 
chosen arbitrarily and independently. 

The last form of statement of the theorem can be interpreted as 
it stands for the present case. But to avoid so much abbreviation we 
will say — 

Hypothesis: 

a) liin s{xi, • •X„-, jr^, • ■ y„) 

(r)= b) 

shall exist. Denote it by 

f{xi, •••, x„). 


b) lim ; yi, •••, ym) 

«=(«) 

shall exist. Denote it by 

9{yu '--.ym). 


c) I * (xj, • • •, x„i y[, • • •, yl^— JTn: y\, ’ • '.Jm) 1 < «. 


0 < A = l, 

where S is independent of (xj, • • x»). 

Conclusion: 

i) f{xi^ • • •, Xn) approaches a limitt 


lim /(xi, •••, Xb) =s a. 
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ii) SP(^i* •**» approaches a limit: 


lim fiyu ••\ym) = B. 


iii) 

Or 


A=^B. 


10) 

lim 

<JP)=:(a) 1 

r lim r(xi, •••, x„; jTi, •• 

•- ym)] = 


lim 

r lim f(xi, •••, x„;^i, •• 
1 

'• J''") j • 


Evercisk 

Show that, in the 5 (m, n) - Theorem, Condition c) can be re¬ 
placed by the following: — 

c) s (m, n) satisfies the relation: 

I s (m, 7i') — 5 (m, n) I < €, ^ v ^ n, n', 

where f* and v both depend on c. 

The conclusion will be the same as before. 

§11. Application: Differentiation of Series. The theorem 
of § 9 is adequate for the needs of practice. If is of interest, however, 
to note the following 

Theorem. Let the series 

1) Wi (;i:) -b MaW -b • • • 
converge in the interval 

a < X < h. 

Let Un M have a derivative and let the series 

2) Ul (x) -f 1/2 W + • • • 

converge uniformly in an arbitrary subinterval whose end points 
lie in the interval. Then the function 

3) /(x) = Ml (x) + M2 (^) + • • • 
has a derivative and 

4) f (x) = (x) + *4 (j?) + • • • . 

Proof. Jjet 


S) 


s„ (x) = Ul (x) + • • • + H«(x). 



UNIFORM CONVERGENCE 


171 


Let Xq and Xq + Ax be two points of the int^ral. Let 

(j?o + Ax) — uj, (xq) 

Ax 

Then i) lim s(Ax,«) = (xo); 

XX) lims(Ax.n)=Xk!>±4£kll(£o), 

71930 UkX 

and we wish to show that 

6) lim I lim s (Ax, n) 1 = lim [ lim s (Ax, n) | . 

This conclusion will be justified if 

iii) 1 j (Ax, n') — s (Ax, n) | < €, v ^ n, /i', 

where € > 0 is arbitrary and v is independent of Ax. Now; 

7) 5(Ax. nO - s(Ax. n) = f + Ax) - 

let ^ (x) = s„i fx) — j„ (x). 

Then the right hand side of 7) has the value 

+ + 0Ax) = 

(^0 + ® Ax) — s!, (xo + OAx). 

Because of the uniform convergence of the series 2) vve have: 

j ('^) ~ (■^) 1 ^ ^ ^ » 

where v is independent of x, no matter where x lies, and hence 
when, in particular, x = Xq + OAx. This completes the proof. 

The theorem is more general than the test of §9 in that it 
does not presuppose the continuity of the derivatives (x). It is less 
general in that it demands the convergence of the series 1) for every 
r instead of for a single x. The theorem is found in Harnack’s 
Differential- und Integralrechnung^ § 129. 


i(Ax,n) =5) 
*=i 
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§12. Condensation of Sins^larities. In the examples of 
non-uniformly convergent series hitherto considered, the removal of 
the neighborhood of a single point of the interval of definition of the 
terms yields a new interval, in which the series converges uniformly. 
This situation is not characteristic for the general case. A series of 
continuous functions may converge toward a continuous function: 

f{x) = Ml (jc) 4- 14, (^) -b • • •, a ^ b, 

and yet the convergence may be non-uniform in every subinterval: 
a ^ a' ^ X ^ ^ b. 

If is easy to construct such examples by a Method of Condensa¬ 
tion of Singularities^ due to Hankel. Such an example is studied 
in the Authoi’s Funktionentheorie^ vol. I, 1928, p. 92, and illus- 
strated by graphs. Starting with the function 

1) y = (x) = i/2e X 

the graph of which is readily plotted, form the function 

2) ifn {x) = ^^r[n sin^ irx). 

It is now easy to plot the graphs of the functions: 

J = jr = r = •••• 

Form the series, the sum of whose first n terms is: 

3) j„(:e) = ifnix) + ^y„(2!x) + • • • + -1: <pn{n\x). 

21 Til 

This series converges to the value 0 for every or, but it 
converges non-uniformly in every interval. 

A further important application of this Principle is to the forma¬ 
tion of non-analytic functions of real variables. A function of the 
real variable, x, is said to be analytic at a point, x = Xq, if it can 
be developed into a power series in the neighborhood of the point, 
i. e. developed by Taylor’s Theorem. The classical example, due to 
Cauchy, of a function which is continuous, together with its deriva¬ 
tives of all orders, and yet cannot be developed by Taylor’s Theorem, 
is the following: 

/( 0 ) = 0 . 


4) 


X ^ Oi 
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I'br the point j :0 = 0 all the derivatives vanish, The Taylor’s ex- 
()ansion: 

/■(xo) + xf> (a;o) + ^ (a^o) + • • • 


converges, but it represents, not the above function, f but the 
function 0 . 

Cauchy’s example has this pecularity in only one point. It is 
easy, by Hankel’s Principle, to construct examples of functions which 
have derivatives of all orders in every point, but which cannot be 
developed by Taylor’s 7’heorein in any interval. Such an example is 
the following, Let 

5) • ^(,r) =/(sin :rx), 

where f (x) is the function 4). Then 


5) 




oo 


z 

72=1 


ip (n\ x) 

(nir 


is the desired function; 1 . c. p. 126. 


Exercises on Chapter V. 


1 . Show that the series: 


^ r” (an cos 7i9 -f hn sin nB\ 

whose coefficients hn are bounded, represents a function which is 
continuous, together with all its derivatives, within the circle r <1 1 , 
and statisfies Laplace’s Equation* 


d'^u 


+ r 


du 


d^u 

TF 


= 0 . 


2 . Let 


be a convergent series. 


Cl + C2 + ‘ • 

Show that the series: 

sh r , sh 2 r , 
Tirr ^2 :T-;=r: + 


shfl ' ''"sh2fl 
converges uniformly in the interval 0 ^ 

3. Does the series 


t ^ a. 


^ 2x 

A 


converge uniformly: 
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i) in the interval — J ^ ^ S i ? 

ii) in the interval — 1 <. x <. I ? 

iii) in the whole interval — oo < < oo, the points a: = 0. 

± L ^ 2, * • • having been removed? 

4. Let the series 

Ui (x) + U 2 {x) + • • • 
converge uniformly in the interval 

a ^ X <. b 

and let it converge in the point x = b. Show tliat it converges 
uniformly in the closed interval 

a ^ X ^ b. 

5. I^t 

f{x) = Uiix) + U^ix) • 

be a series which converges uniformly in the interval 

a ^ X < b ^ 

the terms being continuous in the closed interval a ^ x ^ b. 
Show that fix) approaches a limit when x approaches b. 

6. Ijet ^nix) be defined in the interval a < x < b^ and let 
the sum 

9l (^) + f 2 (^) + • • • + (^)» 


regarded as a function of x and n, be bounded. Let 
^ a2 S •••, limctn = 0, 

ntsa , 


be a set of constants. Show that the series 

Vl (^) + ^2 ?2 (^) + • • • 

converges uniformly. 

7. Let (a:), • he defined in the interval a < x <. b 

and let 


Vnfi^) ^ Tl < rJ \ 

lira ipn ix) = 0. 


Let Cx, C 2 , * * * be a set of constants such that 


Cl + C2 + • • • ^rCn 

is bounded, /i = 1, 2, • * *. Show that the series 
CiViix) -^rc^ipzix) + ••• 


converge. 
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Give an example of such a series which does not converge 
uniformly. 

State a sufficient condition, that the series converge uniformly. 

8. Liety*(j:, a) be a function which, for each a. of an infinite 
point set Ay is defined for every value of x in the interval 

a ^ X ^ h. 

Let ao be a cluster point of Ay not belonging to A, Let f{xya») 
approach a limit when (x, a) approaches a©), where xq is an 
arbitrary point of the interval b\ and a is restricted to the point 
set A. Denote the limit by ipix^)-, 

ip (xo) = liixi /(xy a). 

(XI a)=(x^f Oo) 

Show that f>(x) is continuous in the interval (a, ^). 

9. Prove, furthermore, that the function fixyCt) of the pre¬ 
ceding question converges uniformly as a approaches cCq* 

Is the converse proposition true?—namely: If /(x, a) is defined 
in the points a ^ x ^ hy a. in Ay and if /(x, a) converges uniformly 
as a approaches ao, then f{xyOi) approaches a limit when (x, a) 
approaches (xq, ao), where Xq is an arbitrary point of the interval 
(a, b) and a is restricted to the points of A. 

10. Can a function which is everywhere discontinuous approach 
a limit i) non-uniformly; ii) uniformly? 



Chapter VI 

The Elementary Functions 


§1. The Trigronometric Functions. The noblest branch of 
Physics is Geonietr}', or tlie physical science of space. Next in im¬ 
portance, in the physical sciences, is Kinematics, or the science of 
motion. The most important class of motions is that of oscillations — 
the oscillation of a }X)int, the vibration of a membrane, a wave in a 
three-dimensional reoion of space. The simplest case is that of Simple 
Harmonic Motion, dominated by the differential equation: 


d^x 

dt'^ 


+ r?x = 0 . 


If we change the variable from t to r, where 


r ^ nty 

the new equation becomes: 


£px 

dr^ 


•f X = 


0 . 


It is this differential equation which dominates the whole class 
of phenomena known as waves, and so it is natural to enquire what 
the functions are which constitute its solution. We will change the 
notation and write the differential equation in the form : 

(k) ^+^ = 0 . 

By a solution of this equation in a given interval is'meant a 
function, 

y =/(a:), 

which has a second derivative at each point of the interval and satisfies 
the diffeiential equation; i.e. causes the left-hand member to vanish 
identicadly: 

/"(*) +/(a;)^0. 

It is clear that such a function admits continuous derivatives of 
dll orders. For, {x) exists by hypothesis, and is continuous, sinr^ 
y*" (x) exists. Moreover, y" (x) is continuous, since 

/"W==-/U). 
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Next, /"'(a:) exists and is continuous, since this last equation has 
on the right-hand side a function with a continuous derivative. And 
so on. 

Solution hy a Power Series. As the interval of definition we 
will begin with one including the point x = 0, and enquire whether 
there be a solution given by a power series, 

= zio 4- ^ + ' * • • 

Suppose this is the case. Then 

= 2 ^2+ 3*2^3^ + •** + n(n— + • * • . 

A nec4>ssary condition is obtained by adding these two series. The 
result is a power series that vanishes identically. Consequently each 
coefficient must vanish. 

Uq 4" 2• 1/Z2 ~ 0, 4" 3*2^3 = 0, 

flo 4- 4‘3a4 = 0, 03-1- 5*4^15 = 0, 


The coefficients and ai can be chosen arbitrarily. The re¬ 
maining coefficients are then determined uniquely. Thus, if Oq — 0, 
= 1 , we fmd the series 


X — 



and if flo == L «! = 0, the series 


or X* 

1 —--• • •. 

2! 4! 

Both of there series converge for all values of x and so define 
two functions ; 


1) 


x^ x^ 

s [x) = X-1-- • ' 

^ 3! 5! 


c(x)=l--+-- 


Conversely, these functions are solutions. For each of them, 
when substituted in the differential equation (A), is seen to satisfy 
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it. Or it would be possible to start with the equations for the 
coefficients and show that each step can be retraced. 

The function s (x) is odd, and c {x) is even: 

2) s (—x) = — sU), c{'-x)=c(x). 

Moreover, 

5(0) = 0, c(0) = 1. 

The Derivatives of s(x), c(x). Observe that 

3) s^(x) = c(j:), c^(x) = — s(x). 

Hence 

4) 


/(x)= c(x). 


s"(x) = — 5 (x)y 
s"'(x) = — c(x), 

1^ J**' (x) = 5 (x), 

and now the further derivatives repeat tiieuiselves periodically in 
blocks of four. 

The Addition Theorem, From this property and from the 
continuity of the functions 5(x), c(x) we now infer by the aid of 
Taylor’s Theorem with the Remainder ,, that s{x) can be deve!o*iecl 
about an arbitrary point, x = Xq : 

^2 ^3 

5) s (jTo + A) = .? (jr„) + c (:ro) A — •* (^o) ~ ‘ ’ 


The right-hand side can be written in the form: 

/ ^ A® A* ^ 
*Uo) + ^-) 


-bc(^o) (a - 37 + 57-) • 

Hence we see that 

6) j (xq + A) = s (xo) c (A) -f c (xq) s (A). 

A similar relation holds for c(xo + A). Since Xy and A are both 
arbitrary, we may write more symmetrically : 

( 5 (m + l») = («^) C (v) -H c (w) s (v). 

1 c(w 


7) 


+ v) = c (m) c (v) — 5 (a) 5 {v). 

Thus we have obtained the Addition Theorem for these two 
functions. 
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The Pythagorean Identity. DlFTerentlate the function: 
s (x)^ 4* c (x)^ : 

[^W2 + c(x)2j = 2^j(x)c(x) — c(x)5(x)j^0. 

Hence 

+ c(x)^ = k. 

Setting X = 0, we find: A: = 1. Hence 

8) 5(x)2 + c(x)2=1. 

We shall see a little later that it is reasonable to describe this 
relation as the Pythagoi*ean Identity. 

Roots of 5(x), c{x). .The function c(x) has a positive root. 
For, suppose this were not so. Turn to the function s (x). Since 
s (0) = 0, and, by hypothesis, 

5 ' (x) = c (x) > 0, 

it follows that s(x) is positive and increasing for all positive values 
of X. By the Law of the Mean 

c{x) — c {a) - (x - a) s (X), a < X < x. 

If > 0. 

0 < 5(a) < 5(JY), 

hence 

c{x) < c (a) — (x — a) s (a). 

But the right-hand member is negative for large values of x, since 
5 (a) > 0. From this contradiction follows that c(x) has a positive 
root. Let p/2 he the smallest positive root of c(x). 

Further Identities. Periodicity. From the Addition Theorem 
it follows that 

9) *(x + -|-) =c(x), c (a; + 1^) = - 5 (j:). 

Furthermore, 

10) 5 (x 4- p) = — 5 (x), c (x 4- p) = — c (x). 

and finally: 

11) 5 (x 4* 2p) = 5 (x), 


c (x 4- 2p) = c (x). 
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This last identity shows that the functions j(x), c(x) admit the 
period 2/?. It remains to show that this is a primitive period. 

The function c{x) is even, and hence—/?/2 is the first negative 
root. The graph of the function 


X = c{x) 


in the inteival — p/2 ^ x ^ p/2 
is, then, as shown. From this 



/=f(r) 

1 % 

graph we obtain the graph of 
^ = s (x), 0 < X ^ p. 


0 



by the transformation 
^2 

and the relations 

Since s (x) is an odd function, the graph in the interval : 

-p/2 ^ X ^ 0 

is found by rotating this arch about the origin through 180*. 
Finally, the periodicity gives the complete graph. 

That 2p is a primitive period is now easily shown. For, let o» 
be any positive period. Then 

s(j? + cd) = s{x). 

Hence, in particular, 

5 (cd) = 5 ( 0 ) = 0 . 

Thus a> must be a multiple of p. But the odd multiples are not 
periods. The figures for s(a:) and c{x) are found on p. 196. 

The Simultaneous Equations: s(x) = a, c(x) = p. Let h have 
any value between — 1 and 1, inclusive: 

- 1 ^ A g 1. 

The equation 

12 ) dx) = k 

has two distinct roots in the interval —if —l</i< 1, 
and these are equal and opposite, and X 2 = — Xj. If A = 1, there 
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is a single root, x = 0; and if — 1, the roots are v = p and 
— p. Only one of these latter, liowever, should be counted, because 
of the periodicity. — Siiuilirly for s(x). 

If a, P are any two numbers such th.it 

13) + 0- = 1, 
the equations 

14) s(x) = cc, c(r) = P 
admit one and only one solution in the interval 

0 ^ X < 2p 

or, generally, 

a ^ X < a -i- 2p, 

\\h3re a has any value whatever. For, consider the second equation 
in the interval 

-p < X < p. 

It admits twp distinct roots, and Xo, where 


Xi = — Xi^ 

if — 1 <C P < 1. But 5 (.Co) == — 5(x|) ^ 0, and so only one 
of these satisfies the first equation. 

— The cases P = 1, — t are dealt 
with directly. They do not form 
an exception. 

Dejiniliun of Angle. Con¬ 
sider two directed line segments 
in the plane, Pi and P[ PL 
By the angle, 6, from Pi Po to 
P[Pli shall be meant any solu- -Pr(-^h7i) 
tion of the simultaneous equations; 



15) 



y'2 

-y!- 

U-i - xO 


To 

- Xi 

yz-yi 


A 

-y'l 

xi - x[ 

s{B) = it~‘ 




ro 

-yi 

x-i - Xi 
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« = 1 / + {y '2 - ^0® V (•’^2 - JTi)- + {yz - yif- 

The definition is .invariant of the transformations of the principal 
group (Hauptgruppe) i.e. translations, rotations, and stretchings; but 
a reflection carries 9 over into — 9, Moreover, 9 is invariant of the 
choice of'Pj, on a given line, provided merely that the sense of 
the vector Pi Po is preserved; and similarly for P(, P 2 . Finally, 
the vectors Pi Po and P[ can be replaced by any equal vectors. 
— The proofs of all these statements are simple, and are* left to the 
reader. 

In particular, then, the lines P 1 P 2 
and P{ P 2 can always be replaced by 
two radii of the unit circle; the first, 
drawn to the point (1, 0), the second, 
to the point (x, y). The definition then 
gives: 

16) c{9)^x, s{9)=:y. 

Thus a unique value of 0 ^ 9 <. 2p 
is obtained. 

Equality of Angle and Arc, The number 9 thus defined is 
equal to the length or of the arc of the unit circle, measured fiorn 
(1,0) in the sense corresponding to the inrreiising ordinate near this 
point. For, 

d- dy^ = + s^{9f]d9^- = d9\ 

17) da - d9. 

Angles in Geometry, In Elementary Geometry an angle is 
defined as the figure made by two lines which have an extre.nity in 
common. Each “line” may be a lino segment or a ray. 

To such an angle is assigned a number — its 
measure — by choosing an arbitrary angle as the unit 
and applying it to the given angle in the usual way. 

It is this number which we have defined above as 
the angle 0, with the usual extension of the definition to positive and 
negative angles. 

The iunctions s{9) and c{9) are now seen to be identical with 
the sine and cosine as ordinarily defined in Trigonometiy’’: 

^8) J (d) = sin , c (9) = cos 9, 
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The General Solution of Equation {A), Ijet 
y=f(x) 

be any solution of Equation (A) in the neighborhood of the point 
X ^ a. Then two constants, q and Co, can be so detemiined that 
the solution 

q> (x) = Cl sin x + cos x, 

together with- its first derivative, will tally with fix) at x = a: 
f (a) = Cl sin a -i- Co cos a 
ff {a) = Cl cos /z — Co sin a 

since the value of the determinant is — 1. Thus the solution 
'I'U) — fix) — tp(x) 

is such that 

'I' (a) = 0, \)r' (a) = 0. 

Hence (a) = 0 for all values of n. 

Now, any solution ot (A): 

y = Fix), 

can be developed by Taylor’s Theorem about an arbitraiy point 
X =c. For, 

ix) = ± F(x) or ± F' ix\ 

according as n is even or odd, and so Taylor’s Theorem with the 
Remainder applies. Hence yj^ix) = 0, and the theorem is proved. 

§2. The Logarithmic Function. The definition of the log¬ 
arithm which leads most easily to the properties of this function, is 
by means of the integral. I^et 

r 

1) L(x) = / —0 < < cxD. 

1 

This function will, or course, turn out to be the natural logarithm 
of X, But we are not assuming any knowledge of special functions, 
except what has already been shown regarding the rational functions 
— in particular, their continuity — and so it is better to use a nota¬ 
tion that suggests logx without the danger of taking for granted 
properties not yet established. 
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From the definition follows at once that 
21 1,(1) = 0; /.(a)< 0. 0<«<1; L(a) > 0, a > 1. 



Theorem 1. The function L{x) is continuous for all positive 
values of x. It has a derivative, given by the equation ; 

3) L'{x) = -. 

X 

THi:(jRr.M 2. The function is monotonic increasing: 

4) L{x) < L{y\ X < y. 

For, by the T^aw of the Mean, 

L{y) = L{r) + {y — x) V[x + ^(7 — x)], 
and V{x) is positive for all values of the argument. 

Corollary. From 

L{x) = L{y) 

fellows that 

x^y. 

Thf.orkm 3. The Functional Rflation. The function L{x) 
satisfies the functional equation: 

{A) L{x)+L{y)^L{xy) 

for all possible values of the arguments. 

Let the left-hand side of Equation {A) be written in the form: 
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In the sc{:ond integral, change the variable of integration: 

t ^ XT, 

Thus 



Hence we sec that 

* . y *y 

t r t t t ’ 

1 1 T r i 

This last integral lias the value: 

/f 

and the theorem is proved. 

By setting ^ •= \/x in {A) vve find: 

L{x)-^L (^) =1,(1) = 0. 
or 

5) £(j)=-L(a:). 

By setting y ^ x in (/^) we find: 

L{x^)^ 2 L{x), 

Similarly, 

6 ) L {3^) ^ nL (x), 
where n is any natural number. 

Theoki.m 4 . The function L{x) becomes positively infinite 
for = -f 00, and negatively infinite for x = 0 ^: 

L(+ 00) =r + 00; = — 00. 

Set X = 2 in 6). Then 

X(2") = 7iX(2). 

Now, 2" becones infinite with n, since 2” > n. The right-hand 
fide becomes infinite with n, since L{2) > 0. The function L{x) 
is monotonic increasing. I’his proves the theorem for a: = -h 
The proof of the second part follows from 5). 
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§3. The Exponential Function. The function L(t) admits 
an inverse, defined and continuous for all values of the argument. 
Denote it by E (x ): 

1 ) jr==:E(x) if x — L{y), 

Jt is clear that 

2) /?(x) > 0, — oo < a: < oo. 

Moreover, 

3) /?(-oo) = 0, E{fi)^u co)= + oo. 

Theorem 1 . Addition Thiiorem. The function E{x) culmits 
the Addition Theorem: 

(fi) E{x-\-y)^E{x)E{y). 

This relation is the precise counterpart of {A), §2. For, let x 
and y be any two real numbers. Then the equations: 

u — E {x\ v — E ( 7 ), 

admit unique solutions, for u and v are both positive: 

x — L{u\ y — L{v), 

Now, by § 2 , Theorem 3; 

L{u) ^ L{v) = L{uv). 

Hence 


X y ^ L (i«0» 

and so, by definition ; 

E {x + 7 ) = uv. 


or 

E{x + y) = E(x) E ( 7 ), < 7 . e.d. 

Theorkm 2. The function E (.r) admits a derivativCy 
4) E'{x) = Eix). 


For, if 

y E (r), then x ^ L{y)\ 

and if 

7 + A 7 — E{x A:r), 

Thus 


then 


X Ax — L{y + A 7 ). 
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Ax = L{y + Ay) — L{y) = Ay L'{y + 0y), 

Ay __1_ 

Ax V(y + 9Ay)' 

Now, E{x) is continuous, (Chap. Ill, §9, Ex. 8 ) and so Ay 
approaches 0 as Ax approaches 0. Hence the right-hand side of this 
last equation approaches a limit as Ax appioaches 0: 

l^L'iy + eAy) L'iy)' 

But . 

Hence 

Dxy—y. 

or 

(x) = E {x\ q, e. d. 

Theorbm 3. The function E{x) can he expanded hy Taylor's 
Theorem for all values of the argument .* 

5) E{x^ + A) = f?(xo) + A E<{x^) + E"{x^) + • • • 

The proof is given in the Calculus, and need not be repeated 

here. 

In particular, let Xq = 0, h -= x. Because of 3) and 4), 

6 ) = + 

Thus 5) turns out to be nothing more less than the Addition 
Theorem: 

E{xq + A) = E{xQ)E\h), 

Observe that we have here an independent proof of the Addition 
Theorem. 

The Function oF, We have, incidentally, a new proof for the 
existence of roots, {/ a, where a > 0 is any number. By definition, 

b = l/l[ if M = n. 

In Equation 6 ) of § 2 set it = x = A. Then 

Lm^qL{h\ 
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L{b)= — L{a), 

7 

7) = e[^ L{a)'\. 

Equation 6) of §2 is now seen to hold for all rational \^lues 


of n : 

8 ) 

Hence 

9) 


L (af) =^L(«), 0 < a. 


Now, the function 

E[xL{a)] 

is continuous for all values of x, and so we can define the function 
by the equation: 

10) a* - E[xL(a)l 
From this equation follows that 

11) L{(^)^xL{a\ 

or Equation 6) of § 2 holds for 0 < :r < co, — oo < n < no. 

The Natural Base, e. The functional equation {B) is precisely 
the one studied in Chap. V, § 7. Hence it appears that, if we 
define the number e as ^(1): 

12 ) ^ = ^( 1 ), 

the function 

13) E{x)^^, 

The number e can be computed from the series 6): 


14) 

or 


e = 2. 71828 18284 59043 


The function E{x) having thus been identified with e*, its 
inverse, L (x), is seen to be log x by the usual definition of the latter 
function: 


12) 


L{x) = \ogx. 
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§4 A Simpler Analytic Treatment. The foregoing treat¬ 
ment of the Elementary Functions has the advantage that it links the 
trigonometric functions with the sitnplest of oscillatory motions, thus 
emphasizing their periodicity at the outset; and it yields the proper¬ 
ties of the logarithm with a tninitnum amount of computation. 

From the standpoint of pure analysis, however, one must admit 
that there is no simpler limiting process than that of power series. 
It is possible to make the differential equation 


1 ) 



the point of departure and to seek a solution in the form of a power 
series. We arrive immediately at a particular solution: 

2 ) 

The derivative of this function has the value, from Equation 1 ): 


5) 


E'ix)==R{x). 


Now follows the developability of this function by Taylor’s 
Theorem: 

4) E {xo + h) = E (xo) + h E' (xo) + — E" (xo) + ■■■ 

Hence 

E(xo -h /i) = EUo) R{h\ 
and herewith the Addition Theorem : 


6 ) E{x + y) = E (.r) E{y). 

The theory of this functional equation leads at once to the 
identification of E (x) with c*: 

6 ) E (x) = 

In particular, then: 

7) E{x) > 0, — oo < X < oo; 

8 ) E{-oo) = 0+, £(0) = 1, £(+oo)= + oo. 
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I’he existence and the properties of the function and the 
treatment of the logarithm as the inverse function, follow without 
artiHcialities of any sort. 


Tfie Trigonometric Functions, The use of imaginaries is so 
familiar to the electrical engineer of the present day, that the 
l/ — 1 can no longer be regarded as a mathematical fiction, even by 
the practical man. If, then, starting with the traditional equation 


9) e?* = cos ^ + I sin £ = ^/ — i, 

we define two new functions by the equations: 


S(x) = 


C{x) = 


2£ 

^ + e- 


we prove immediately by elementary algebra that these functions have 
the properties: 


S{x^y)=S{x) C{y)^C{x)Siy)-, 
C{x^y) = C{x) C{y)-Six)S{y). 


12 ) 

15) 

14) 


■ S' (a:) = C (*), C' (*) = - S (*). 
S(ar)2+ C(i)®= 1. 

Six) =ix -H-••• 

^ ’ 3! 5! 




Finally, the periodicity is established as in § 1, and by means 
of the angle these functions become identified with sinx, cosj:: 

15) 5(x) = sinx, C{x)^cosx, 

§5. Partial Fractions. Development of cotx. The 

functions tana;, cotx, sec or, cscx can be represented by infinite 
series which are analogous to the representation of a fraction by par¬ 
tial fractions. The fundamental equation is the following: 
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This equation can be obtained immediately from the develop- 
ment of a function into a Fourier’s series; cf. Chap. VIII, § 1 . An 
elementary deduction can be given by means of de Moivre’s Theo¬ 
rem : 

cos m ^ = cos"* ip -cos "*-^ip sin ^ip + 

1 * A 

m(m — 1 ) (m — 2) (m — 3) . 4 

—i^ cos"* * ip sm^ • • • 

41 


sin m ^ = m cos"*""^ ^ sin ^ — 


m (m — 1 ) (m • 
31 


cos"*~* ip sin® ip 


4.... 


We see that cot m ^ is a rational function of tan ip: 


cot = 


g:(tany) 

G(tan^) 


Let m be odd: m = 2 fA -h 1 . The function on the right is a proper 
fraction, as is seen by allowing ^ to approach the limit ir/ 2 ; for 
then the left hand side approaches 0 as tan f becomes infinite. 

We proceed to represent this fraction by means of partial frac¬ 
tions. I’he degree of the denominator is obviously not greater than 
m. On the other hand we can write down m distinct values of 
— r/2 < ^ < v'/2, for which cot mip becomes infinite, namely: 


^ = 0 , 

Consequently, 



±i^. 

m 


G(tan jp) = tan^ ^tan^ —tan~^ ^tan y-h tan 


We thus find: 

cotmf= 2 , - 

tan ip — tan- 

^ m 

To determine the coefficients multiply through by sin m ip 
and then let ip approach the limit kT/m. All the terms on the 
light approach 0 except the term in Aky which takes on the indeter¬ 
minate form 0/0. The limiting value is found by the usual method 
of the calculus. Thus 
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cos 


kv ^ ^ ^ ^ 


hjL 

m 




1 2 

-—- - C£U'^ _ 


m 


On setting mip ^ x we obtain the final formula: 


1 ) 


or: 


2 ) 


cot 




sec*" 


kir 

m 


***'"• m tan-m tan- 

m 


cot x = 


m tan 


+ S 


o o 

2 sec“ — m tan — 
7 w m 


kfsil rn^ 


rnr tm“- 


m- tan- 


kT 


Allow m to become infinite. The terms on the right of 2) 
approach limits, and it would not have occurred to the mathema¬ 
ticians of even a hundred years ago to question the inference that 


3) 


ot 


4 

* = - + Z 


2 :r 


h^\ 


x'^ — A*** r- 


This result is correct, but it requires proof. 

The right hand side oJ 2) can be regarded as an infinite series 
whose terms depend on m (j: is a constant, ^ ± k t) and which 
converges for* m = 1, 3, 5, • • •; 

f (m) == Mo ('«) + “i ("*) -f • • • 


The terms of this series approach limits as m = oo; namely, the 
corresponding terms of 3). And now the series of the limits, i.e. 
the right-hand side of 3). and the litnit of the series, i.e. the left- 
hand side of 3), will be equal if the series converges uniformly; cf. 
Chap. V, §4, Ex. 1. or § 10. That this is the case can be shown 
by an M-test. We have already chosen x. Let A > ! x 1 . Then 


X 

m tan — 
m 


< A, 


mo ^ m. 


* It may happen that for sirmll values of m the function tan ^ is not 
defined. In that cate, begin with a larger m; i. e. let v s m. 
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On the other hand, the function f{x ); 


j./ , sin a: 
( = - 


o<.s| 


is continuous and positive in the closed interval (0, r/2), and hence 
its minimum value, is positive. Hence 


0 < ^ < 


sin X 


0 < :r ^ . 

2 


If, then, we set 


M* = ■ „ -75 , Ao ^ k, 

Ac** ir“ — A^ 


we have here an M-test. This completes the proof. — On replacing 
X by ir.r, the development 3) goes over into {A). 

Corresponding developments for the tangent can be obtained, 
either by the same method or by a change of variable, a: ~ | — jr'; 
or still again by means of the identity: 


I’hus: 

4) 


tan X = cot — 2 cot 2x. 

^ TX _ ^ _2£_ 

^ Un— + 1)8 - a:'-* ’ 


TlBSsO 


5) tan X ~ 


2 :r 


2x 


2x 




The identity: 


1 ^ 

-= cot --cot X 

sin X 2 


leads to the development: 

IT 1 2a: 


6 ) 


2x 


2x 


sin vx X 1 — x^ 2- — 3^ — x^ 

And now a change of variable gives: 


7) 


TX 

cos- 2 - 




*2 32. 


+ 52 _ ai ■ ■ ■ ] ■ 
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Linear Denominators, In one respect these formulas are lacking 
in simplicity: the denominators are factorable. If we had tried to 
use Equation 1) instead of Equation 2), we should have arrived at a 
series whose terms are 

1 

X kr * 

But the series 

y_ \ _ 

^ X kT 



do not converge. 

It is possible to obviate the difficulty by writing: 


2 x r 


1 + r ^ - M 

x* - A*!-® ” L 

X kv kv . 

J L a: + ^r A*r J 

Thus ^ 

8 ) cotj; = — + y f 

^ .S'- 

■ 1 +1 

1 +f r 1 - 1 1 

X — nv nr 


The introduction 

of the additive 

terjn 1/A:r or — l/A*r seems 


artificial. How did we come to think of it? A satisfactory answer 
can be given if we start, not with the cotangent, but with the square 
of the cosecant. Proceeding as before we find that 

1 ^ J- 4- V 1 1 ^ t 

sin^ X ^ (x — nTf {x + /I'lr)- 

and this equation can be written in the simpler form: 


9 ) 


csc^x = 


oo 

y_ \ _ 

(x-tlT)-- 


Consider any inter\'al, 


— .*4 = j: = A. 

The series: 

oo oo 

i -7-X A < mT, 

iSrz (a: — 71 r)- U -I- n' Ty 

converge imiformly in this interval, and their terms are continuous 
Hence 



-2 [— 1 - + -L], 

-r — 71 r nr -■ 
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with a similar expression for the other integral. Now transpose the 
omitted terms in 9), so that the left hand side becomes: 

m—l 

X 7-v>- 

U - n r)- 

That indefinite integral of this function^ which approaches 0 as x 
approches 0, must be equal to the sum of the two integrals we have 
just considered. Thus we arrive in a perfectly natural manner at the 
development 8). It is customary to write it in tlie form: 


101 


cot X 


X X — nv TIT J 


the prime denoting that the value n = 0 is to be omitted. 
The second form of the cotangent development is: 


11 ) 


V cot v-x = — + [ — - -h 1 ‘ 

X ^ X ^ n n 


These developments have the advantage that each term of the 
series has a pole at just one point. 


EXERaSES 

1 . Obtain the development 6) by means of partial fractions. 

2. Deduce Taylor’s expansion for sine and cosine from 
de Moivre’s Theorem : 



x^ 

sin X = X - 

+ “ 

31 

51 


X* 

cos X = 1- 

+ ' 7 ” 

2 ! 

4! 


3. Develop the definition and theory of the exponential func¬ 
tion on the basis of the limit: 

E {x) == lim f 1 + ~ ^ . 

/ne=oo V /7l / 

Obtain the functional equation: 

E{x jr) = E{x) E (jr) 
directly from the definition. 

4. Replace each of the other developments by one in which 
the terms have a pole at only one point. 
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§6. Infinite Products. It is now easy to pass to the devel- 
t^ments into Infinite Products. Thus 


1 ) 

2 ) 



3) 


sin rx 


/ X \ * 

* n 



Chapter VU 

Alj^ebraic Transformations of Infinite Series 

§1. Elementary Theorems. We have defined Infinite 
Series as the mark (Chap. 1, § 1) 

1 ) iiQ + ux+ 

It converges when the variable 

2) Sn = + 2^1 + • • + Z/n-1 

approaches a limit, n = co. 

We pointed out that the series 1) converges when the series 

3) Wm “h Z^m+1 4* * * ’ 

converges, m being any fixed number; and conversely. Also, that, 
when 1 ) converges, the series 

4) A: z/q + ^ 4 • • • 

converges, k being any constant. 

A necessary condition for the convergence of the series 1) is, 
that lim zz„ = 0, n '= oo. And a sufficient condition for convergence 
is, that the series of absolute values, 

I «0 I + 1 Kl I + • • •. 

converge. 

All this before the €-definition of a limit had been formulated. 
It is hard to know how systematic to be wdth these early theorems. 
They are like the propositions with which the old school books in 
Elementary Geometry used to begin: “All straight angles are equal.” 
They puzzle the beginner by their obviousness, and are useless to the 
advanced student as formulated laws, since be automatically thinks 
in terms of them. W^e will try to be complete without seeming to 
be pedantic. 


Exercise 

Examine each of the general theorems of convergence which appear 
in Chap. 1 and give an €-proof, or refer the proof to such theorems 
as you have already proved by c’s. 
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§2. The Commutative Law. If a series 
+ 1^2 + * • * 

converges absolutely, its terms may be rearranged at pleasure and the 
new series will converge to the same value as the old. 

For, let 

= Ml + • • • + li„, 


and suppose first that 0 ^ Let the rearranged series be 


with 


' 1 ' I 

Ml + l/o + 

f f I 

+ “ • 


If the value of the first series be denoted by f/, then 

s'n g U. 

Hence the second series converges, and its value 

C7' < U, 


Now interchange the series, regarding the first as a rearrange¬ 
ment of the second. Then 

V ^ 

and so V* = U, 

In the general case, let 

5/, = (Tp ry , 

as in Chap. 1, §9. Let 

f f r 

. 

Then, by the result just established, 

lim (fp = lim a J,/, liarr'-^ = lim rj,, 

and the proof is complete. 

If, on the other hand, the given series converges conditionally, 
its terms can be rearranged so that the new series will converge to 
an arbitrarily preassigned value, A. For, take positive terms till the 
sum exceeds A ; then negative terms till the sum falls below A ; 
then positive terms again; and so on. The process can be continued 
indefinitely, since the variables <r^, vq diverge monotonically toward 
+ 00 . Moreover, since lim Un = 0, the new series will converge 
toward A, 
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The terms can evidently also be so rearranged that the new 
series will diverge toward + co or — oo, or oscillate at pleasure. We 
can state the result as follows. 

Takorem. Let 

Ui + 1^2 + * • • 

be an absolutely convergent series^ and let 

ft ft 

+ 1^2 + • • • 

be a series made up of the UnS rearranged in any manner. Then 
the latter series converges absolutely to the same value. 

Exercises 

1. Show that, if every series formed out of the terms of a 
given series converges, the given series converges absolutely. 

2 . Show that the terms of a conditionally convergent series can 
be rearranged without altering the value of the series, provided no 
term is moved more than k places, where A: is a constant. 

§3. The Associative Law. Let 

Ml + W2 H- 

be a convergent series. Then it is possible to insert parentheses at 
pleasure: 

(Mx -}-•••+ + (M/hx+i + * • • + M/nj) + • • • 

and the new series will converge to the same value as the old. For, if 

= Ml + • • • ■¥ Un 

and if sjJ is the sum of the first k terms of the second series, then 
the sj are merely an infinite subset of the SnS, Hence: 

1’hkorem 1. In a convergent infinite series, the terms may 
be grouped in parentheses in any manner and the new series wUl 
converge to the same value as the old. 

The converse is not true. Consider the series of parentheses 

(1J — 1}) + (ij — li) + • • • 

llils xnes converges; but if the parentheses are removed, the general 
term of the new series does not even approach 0, and so the series 
diverges. We can, liowever, state the following theorem. 
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Theorem 2. IM 

2 (“-»* + 

k 

be a series of parentheses. If^ on removing the parentheses^ the 
new series converges^ then the old one does, also, and the values 
are the same. 

The proof follows at once from Theorem 1 . 

Theorem 3. Consider a convergent series of parentheses. If 
the number of terms in a parenthesis remains less than a fixed 
number and if the general term in the parenthesis approaches 0 , 
the parentheses may he removed; i.e. the new series will converge 
to the value of the old one. 


Exercises 

1. If + % 4* • • • 

and 

i'l 4* ^2 4* • • • 

are convergent series, show that the series 

4" ^jL 4“ ^2 4" ^ 4- • • • 

converges, and that its value is equal to the sum of the two given 
series. 

2 . Extend the result to the sum of p scries. 

§4 Double Series. By a double series is meant the array 
*^J1 + Mi 2 + w,8 4- • • • 

Ifjl + ^22 4" 1^23 4- • • • 

Wsi 4" ^32 4" M 33 4" • * • 


where Umn is any function of the two natural numbers, m and n. 
Another form of the double series is: 

w,i» 

The series is defined to be convergent if every simple series formed 
out of its terms converges. Thus if a double series converges, it 
necessarily converges absolutely. 
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This is the definition which is useful in the thsory of functions. 
In special branches of analysis, like the developments for which 
double Fourier's series are charatceristic, other definitions are expedi¬ 
ent. 

It is obvious that the senes 1) converges if there is a convergent 
double series 

5) Vmn, 0 S Vmn, 
n 

such that 

I 1 = 

It is sufficient that these inequalities hold for 

Af ^ m 4* n, 

where M is some fixed number. 

The terms of a convergent double series can bo rearranged at 
pleasure. In particular, the rows and columns may be interchanged. 

Of the many ways in which a convergent double series may be 
evaluated, two are especially important: 

i) Summation by Rectangles : 


*^ 11+^12 + ^ 13 +. 

W2i + **« + «2S + **‘ ' ••• 

. > ... 

- < - .< -<- 


where the sides increase together in any manner — for example, al¬ 
ways equal: 

“ll + Wl2 + **22 + **ai + **13 + **23 + • • • 


ii) Summation by Diagonals : 
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Example, Q>nsidcr the double series: 

1 X + -f • • • 

X + * 

+ -3^ + * * • 

If we sum by diagonals, we are led to the series : 

1 + 2:c + 3x- + • • • 

This series converges absolutely for all values of — 1 < :r < 1 , and 
diverges for all other values of x. Hence the double series converges 
for — 1 < a: < 1. 

The following criterion for convergence is useful in practice. 
Tkst for Convergencf. Let 

Vii + + t^i3 -f * * * 

1>21 + t>22 + t'*23 + • * • 

V^l + ^32 + • • • 

be a doable series whose terms are all positive or zero: 0 ^ 

If 

i) the rows converge: 

t'/i = + 1^2 + * • * 

ii) the series of the values of the rows converges: 

r = vx + + • • •, 

then the double series converges. 

Proof, Denote by the sum of the terms occupying any area 
A in the scheme of the double series. Then 

For, choose n large enough so that A will be contained in the first 
n rows. Let 

Jn - Vl + 1^2 + • • • + 

Then 

and 

S V. 

Hence 

and the theorem is proved. 
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Tni'.onr.M. Let 

Kll + Mj2 + + • 

Moj 4" M 22 ^^23 *4* * * ' 

*<31 + **32 + * • • 

•.. 

be a convergent double series. Then 

i) the rows converge ahsolulely: 

**n = **„i 4- 4 * • *; 

ii) the series of values of the rows coniferges absolutely: 

U = iZj "f* {Z2 -f* • * * 

iii) 1] is equal to the value of the double scries. 

Proof. The truth of i) is obvious. Next, denote the value of 
the double series by t/'. Then, in x^^'i'ticular, 

I W — 1 < €, V S n, p ^ p, 

where s^p is the sum of the first p terms from the first n rows. 
Allow p to become infinite, and let 

Jn = Ml 4* • • • 4 M/I. 

Then 

\ U' — s„\ ^ V S n. 

Thus ii) and iii) are established, and the proof is complete, except 
for the absolute convergence under ii). But this property appears at 
once on comparison with the double series of absolute values. 

The process of evaluating the given double series by means of 
the series S Un may be suggestively described as “summing by 
rows.” Since the terms in a double series may be rearranged at 
pleasure without affecting the convergence, it follows that the series 

U2P + uip • • • 

converges — denote its value by Vp — and fiurthennore the series 

4 • • • 

converges to the value 11 of the double series. This process may be 
suggestively described by the words: “summing by columns”. We 
may enunciate, then, the following theorem. 

Corollary. A convergent double series may be summed by 
columns as wdl as by rows. 
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Multiple Series in General, All of the foregoing definitions and 
theorems admit immediate generalization to multiple series, n > 2: 

2) m 2 • • • » 

where • • •, independently run through the natural num* 

bers. 

Product of Two Series, Cauchy’s theorem relating to the pro¬ 
duct of two series can now be proved with ease. I-et 

Ml -f it2 -I- • • •, 

+ ^2 + • • • 

be two absolutely convergent series. Denote their values by 
Then the product is represented by the following absolutely conver¬ 
gent series: 

^ ^ = Ml + i/i ^2 + “2 + ’ * * 

Proof. Form the double series: 

Ml Vi + + • • • 

M2 -h M2 1^ + * • • 

This series converges. For, the series of absolute values: 

I Ml I I Vl I + I Ml I I 1^ I + • • • 

ImoI IviI + ImjI 1wi1 + -- - 


converges by the. Test for Convergence. 

Returning to the first series we see that the n-th row has the 
value Un y. The series of values of the rows thus becomes: 

Ml r+ M2r+ •••, 

the value of which is U V, Now, this is also the value of the 
double series. On summing the double series diagonally, the product 
theorem results. 

Extension of the Theorem. It is not true that any two convergent 
series can be multiplied in this way, for the resulting series may 
diverge, as is shown by examples. Still, it is true that if the re¬ 
sulting series converges, it converges to the value that is the product 
of tlie values of the given series. For, form the pov^r series: 
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/(or) = lii X + M 2 ^ + ••• 
y (a:) = Vi ar -f t ;2 4* • • • 

By Abel’s Theorem, Chap. V, § 6, each converges uniformly in the 
closed interval 0 ^ x ^ 1; and now the same is true of the pro¬ 
duct series: 

f{x) ip (r) = Ui Vi -\r {uiv^ luvi) 3? • • • 

This proves the theorem. 

%S. Series of Series. Let a convergent series be given whose 
terms are sums: ^ ^ 

1) S ‘' 

A=:l A;bs1 

Then this series can be written as the sum of m series: 

oe oo oo 

2 ) S 5 !) “ 2 n “^ * * * “^ 2 ’ 

n=r n=l Ms=l 

provided each of these latter series converges. In other words: 

oa m m oo 

3) 

72e=sl AtessI AtbssI nasi 

Suppose, however, that the terms of the given series are infinite 
series : 

4) 

The analogue of the sum 2) is now the infinite series: 

5) 5) «!„ + + • ••. 

/leal 

and the question is: Will the series 5) be equal to the series 4) ? — 
provided, of course, that all the series involved converge. 

It clarifies the situation to formulate it as a double-limit ques¬ 
tion: — Will 

6 ) 

That the convergence alone is not enough, is suggested by all 
our experience with double limits and is proved by a simple example. 
Consider the double series for which 




Tlsssl rn=:l 


ms=l russi 




W *1 


+ + 
*=1 


n 

m -t- 


imn — 
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where Smn denotes the sum of the terms in the first rn rows and the 
first /I columns* The double limit on the left of 6) converge to the 
value 

lim Smn = 0. 

msssx 

The double limit on the right of 6) converges to the value 

lim Smn I • 

n=^oo 

A sufficient condition for an affirmative answer is given by the 
following theorem. 

Tiirorem. a sufficient condition that the value of the infinite 
series whose terms arc themselves infinite series: 

CO no 

2 “ml + X “m2 + " ■ 

m—l m=sl 

be given by the series of series t 

Ural nml 

all the series involved being convergent^ is that the double series: 

“11 + “12 + “13 + • • • 

“21 "i" “22 “23 “h * * * 

“31 + 2^2 + • • • 


converge. 

That the condition is not necessary, seems likely and is proved 
by the example: 

i-i 

i-* 

the terms not lying in the two diagonals being all 0. The example 
is due to Mr. £. J. Moulton. 

Pons asinorum. At thb stage of analysis writers and students 
are prone to a mistake that might seem to be an individual matter 
were it not for the facts of experience to the contrary. By a oonfu* 
sion of ideas the following theorem is developed: 
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“If the series which form the terms of 4) converge absolutlely, 
and if the series 4) converges absolutely, then the series 4) is equal 
to the series 5).” 

This theorem is false, as is shown by the following example due 
to Arndt: 


V 2 '2 2 ’ 2 

V. 2 2®/ V 2 2® 3 32 / V 3 3® 

V 2 2®^ V 2 2® 3 3®/ V 3 3® 


1 3 X 

4 * 4 ) 

1.^) 

4 4.2/ ’’’ 

± 

4 ’ 4 ®* 


Nevertheless, this false theorem is rediscovered by each new 
generation of students and writers, and there is no cure known to 
man. 

§6. Power Series. Throrem. Z^t a futwtion given 

by the power series: 

1 ) f(y)=h + bix+b2yr^+ -S<x<Si 

and let ip {x) be a function given by the power series: 

2) (:r) = tfn + ^ + «2 ^“ + • • •» ^ R < X < R, 

Let < Uq < S. Let 

3) r = 

where x is restricted to a certain neighborhood of the point = 0, 
Thus 

4) /(j)=/[y’U)] 

becomes a function of x in this neighborhood. 

Then the fwiction fipix)] can be expressed as a power series 
in X, the coefficients of which are found as follows. Let each 
term in \) he expressed as a power series in x: 

5) b„y = 4"’ + + 4”’^^ + • • • 

and now let these power series he added as if they were pclynty- 
mials: oo 

6 ) + + ••• 

nosO ricssO n -0 
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The proof by means of double series is immediate. Form the 
double series whose n-th row is the power series 5): 



0 

0 

bi ao 

bj ai X 

bi «2 !xr 

^0 

fo) 

aY X 

4 '’ ^ 


This double series converges. For, consider the power series 

8) I 1 + I I +1 1 + • • •, X = 1 :r |. 

Denote its value by Y and form the power series: 

9) 1 in 1 r" = 4"’ + X + Ai”^X^+--- 


The double series whose n-th row is the series 9) converges, if X be 
suitably resticted, and 

14"’I ^ 4”’- 

Hence 7) converges. 

A case of especial importance in practice is that in which 
tfo — 0. The coefficients of x in the expansion are then series which 
break off with a finite number of terms. 

Example 1 . Consider the function: 

_ 1 _ 

>/ 1 — 

It can be represented by a power series in x^ convergent tliioughout 
a certain interval. For, let 


Then 




Vi-y 


^ y (x) = 2 a; — 




The powers of jr are here polynomials in x, and the cocfiicients of 
the early terms in the expansion are readily computed Let 


1 


•|/ 1 ~ 2 ft X + 


=“ -Po (^) + Pi (ft) a: + P2 (f**) + • • • 
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The coefficients are known as Legendre's polynomials or Zonal 

harmonics. We find at once: 


Po (/^) = L Pi (h) = P2 (ft) - i (5 ,.2 ~ IX 

Ps (ft) = i (S /I.® — 3 ft), P4 (ft) = I (35 ft* — 50 ft® +3). 


The example is unsatisfactory in two respects, and seems here* 
with to disparage the theorem. First, there is no indication how 
far the region of convergence of the series extends; and secondly the 
law of the coefficients, i.e. the polynomial Pn(ft) for an arbitrary ji» 
is not revealed by the theorem. True; but these are not questions 
the theorem undertook to settle. The theorem has given us the 
definition of the Pn (ft) which lies nearest to the application of these 
functions, and moreover has provided us with an extremely simple 
iiieans of computing the early ones. 

The example just discussed suggests the relation of the theorem 
to the Cauchy-Taylor Theorem in the theory of functions of a com¬ 
plex variable. The latter theorem tells us not only that the composite 
function can be developed into a power series, but it tells us also 
just how far that series converges, and it gives an explicit determina¬ 
tion of the coefficients. The advantage of the present theorem is, that 
it affords a more convenient means of finding the early coefficients, 
and sometimes the law of the series. 

It is not true in general that, if the terms of a series can be 
developed by Taylor’s Theorem, and if the function represented by 
the series can also be so developed, then the coefficients in the latter 
development can be obtained as in the theorem. For example, the 
function 


f{x) = — x 

can be developed into a Bburier’s series, Chap. VIII, §§ 1, 7, 8: 


/(^) = 


sin X 


sin hx , sin 5.r 

9 "• t* 


and each term can be developed into a power series; but the latter 
cannot be obtained by forming the series of like powers of x. 
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Example 2. The function cot x. 

cotx = = < - * - 

sin X X — J ar* + liox^ _ ... 

_ 1 — J X® + X* — • • • 

“ X 1 - 4 X* + tIbx* _ ... ■ 

Here, we can develop the function 

1 

by setting 

jr = i:x^ —xic ' 

and applying the geometric expansion: 

— = 1 + ;r + 

1 — ^ 

Then multiply the two power series together. This shows that there 
is an expansion of the form: 

cot A' = -^ -f ^ 4* -f d" ‘ ; 

X 

but there is a simpler way of obtainin:]j tlie early coefficients. 

It is easy to show that tlie quotient of any two conviegent |X)wer 
series: 

tfp 4- 1 4- go ^ 4“ * • * ^ -A n 

Ap 4- 4- ^ " 4- • • • ’ ® 

can be found by dividing the one series by the other just as if they 
were polynomials; cf. inf. Exs. 9-11. Applying that method here 
we have : 

1 — j - A « 

1 — 4* ~ 

1 — i r® 4- ~ 




A - 


Hence 


cot X =-4 X — ^5 4- 

X 
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Exehcishs 


Compute the coefficients in the following expansions through the 
term of the fifth or sixth dimension — or higher, if convenient. 


1. sin ^(Asinj;) 




2. 


log cos a:. 

Suggestion: 

Set 

_ a:2 a:* 



21 41 

3. 


l^'cos X, 

4. 


log(l + e»). 

5. 

(1 + a:®)/(l + a: + a:®). 

6. 


tan X, 


7. Show that 

log sin a; = log a: — f + *••. 

8. Compute; 

T 8 I 02 : cos 4- 8 — 8 cos :f -f 
x^o 2 tan 2 : — 2 sin X — JT 


9. Show that the quotient of two convergent power series, 

Oq X -h -h • • • h n 

^0 + ^0 -^ + ^2 c ' + • • • ’ " ^ 

can be written as a power series: 

C(^ -\r Cx X + • • •. 

10. Determine the coefficients c„ in Question 9 by setting 

ao + ax X -h ao 

= (^0 + + /-'2-^‘^ + • • •) (co + + Co-r® + •• •). 

multiplying out, and equating coefficients. 

11. Prove that the values of the Cq, q, r 2 , • • • as found in 
Question 10 are the same as those obtained by long division. 
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12. Let the terms of the series 


V [ —! -] 


be developed into power series in x: 

1 1 X or 

_ t ---^- 

X n n TJ? r? 


- \ < X < \. 


Show that the value of the given series is expressed by the series 

OO 4 

“ ■■■ 

iS” iS ” 


13. Show that the function represented by the series: 

ai sin X ao sin 2.r + • * *» 

where \ an \ < y” and y is a positive constant < 1, can be developed 
into a power series in x, 

14. Show that the function repit»ented by the series 

Cj ^ sh X -H C 2 sh 2x + • • % 

where the coefficients Cn are bounded, is analytic at the origin; cf. § 9. 

§7. Bernoulli’s Numbers* The coefficients in expansions 
like those considered in Chap. VI, § 5 admit simple expression in 
terms of a set of numbers defined as follows. Consider the function: 


2 e' - 1 ‘ 


It can be expressed as a power series, and since it is an even func¬ 
tion, only the terms of even degree will enter. Let us write, then, 


1) 


— g* +» 
2 e* - 1 




21 


4! 


’ 6 ! 


The coefficients Bj, Bo, • • * are known as BernoiillVs Numbers, 
It is easy to obtain a recursion formula for computing them. 
Equation 1) is equivalent to the following: 







)( 
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On multiplying out and equating (oefficients we find : 

^ = 1 ; 

1 ^ _ A Sr _ So 

2 n! {n + 1)! 2!(n - 1)! 4!(n-5)r 

The sum on the risrht ends with 


(^)!‘2! ■ 


when /2 ~ 2/Ji + 1 ; 
when n = 2^. 


(-1)^^ 

The first few S’s have the following values: 

Sj ~ g , S2 = » -S3 = , 

^4 50 » ^5 " 1 -Sc = 2^3^ . 

The Sum nT. To find the sum of the r-th powers of the 
first n natural numbers : 

r 4- 2^* + • • • -f 

It is convenient to develop the formula for n — 1 instead of n. 


Let 

Then 




On the other hand. 


and 




1 


1 


1 x 1 ’ 

X _ X \ X 


1 2 - 1 

1 - + S, ~ S., — 4- S, 

0 ‘ uf - 4! 


61 


Hence 


^n^x^ , n^x 

«r + 


r = 




= ^0 + -^l ^ + ■'^z + 


4* Ar Olf 4” 
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We tee, th«t, that 




On the other hand Ar can be computed by multiplying together 
tlie two power series and comparing the coefficients: 

. H-i _L ^ ^1 n 


Ar = - 


[r + 1)! 2 rl 2t (r - 1)1 

The final formula is: 

r + 2'' + • • • + (n - !)'• = 

§ 8. The Development of cot x. From the developmmt of 
Chap. VI, § 5: 


1) 


TcotTX = -+ Vf^ ---] 


it is possible to derive a development in terms of a power series, 
S7, Ex. 12: 

2) Tcotrx^-2x5'—5 — 2a:*5) A “ “ * 

til 

plex doinin as 


^ ^1 w" 

On the other hand the cotangent can be expressed in the com- 


^ cos irjr . -f 

T cot TX = T - = n - 2 -- 


sin vx 




_ }_2ivx + 1 

X 2 - 1 

This last expression is the basis of the definition of Bernoulli’s 
Numbers, § 7. Thus we find : 


5) 




Similar expansions hold for tanx, secx, cscx. 



1 

The Series ^ ^. A comparison of the series 2) and 3) leads 
to an evaluation of the seiies of negative even powers of the integers. 
We have: 
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„ 

§9. Analytic Functions of Several Variables. A func¬ 
tion of n variables, /(^i, • * *, Xn), is said to be analytic in the point 
{a-i, • • •, an) if it can be developed into a power series : 

1) * * *» ^ • • • * rrin (^1 ““ * * * i^n 

which converges for a point (£i,***£n) such that 

5^ 0, k= 1,* • •,n. 

For simplicity, let n = 2 and write: 

2) Jix,y) — Coo + Ciox + Coi y + c^ox^ + Cn xy + Coj + • • • . 

If this series converges for a point and if £ ^ 0, ij 0, then 

it evidently converges for all points (x,y) such that 

3) Ix| g II!, IrI = h I- 

If the coefficients are bounded, ! Cmn I = Oy then the series con* 

verges at least when 

4) I x I < 1, I j I < 1. 

The domain Of convergence of a power series in several variables 

is not simple. Thus the series 

1 + xy + x^y^ y^ + • • • 
converges in every point {x, y) such that 

I I < 

and diverges for all other points. Hence the points of convergence 
are those which lie on the convex side of both hyperbolas: 

xy = 1, xy = — 1, 

A point (£,«j) is said to be interior to the region of convergence 
if the series converges for a point 

1 5 1 + «. 

where a, are both positive. 


1 + p 
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If the series 2) converges in the point (x^ r), then each of the 
series 

converges, and 

m=sl n»l 

But the converse is not true; the convergence of 5) does not 
insure the convergence of 2). 

A convergent power series can be differentiated term-by-term 
at any point interior to the region of convergence, and the derivative 
series will admit at least the same region of convergence as the 
original series. It follows, then, that the coefficients in a convergent 
power series are given by Maclaurin’s Theorem: 

6) fU, y) =/(0,0) +/, (0.0) a: + /, (0,0) .V + iAo (0,0) X-- + •. •. 

The theorem of § 7 admits immediate extension to power series 
in several variables. As a consequence we have the following im¬ 
portant property of power series. 

If (5, 1 }) is an interior point of the region of convergence of the 
power series 2), then f{x^y) can be represented by a convergent 
power series; 

/(£ +A.1 

throughout a certain neighborhood of the point If follows, 

then, that if a function is analytic at a point, it is analytic at every 
interior point of the region of convergence of the series. The domain 
of definition of the function may novv be extended by the process of 
analytic continuation familiar in the theory of functions of one and 
of several complex variables. 

Taylor’s Theorem for an arbitrary interior point of the region 
of convergence of the power series now follows at once: 

f {x, y)—f Cxo. n) + /lo (^0. ro) (* - aro) + /oi (xo, yo) (y - ^o) 

1 2 

+ ^/ao (^0. yo) (xq, yo) (x — x,) (y — y^) 

• 1 

+ ^/o2(xo.:ro) iy - + • • •• 




n=:l 
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Analytic Curve^ Surface^ etc, A curve: 

A: = 1, • • 71, 

is said to be analytic at a point (x®, • • *, orjj) if each of the func¬ 
tions xjc (t) is analytic at the point t = to = ^k (^o)? ^i^d if, 

furthermore, not all the derivatives x]^ (t) vanish there. An arc of 
a curve is said to be analytic if it is analytic at each of its points. 
A surface: 

A* = 1, • • •, 71, 

is said to be analytic at a point (x®, • * •, xj) if each of the func¬ 
tions (i/, v) is analytic at the point (wq* ^o) ^A = ^k ^o) *» 

and if, moreover, the rank of the matrix 


dxi 

• 

du 

du 

dx\ 


dv 

dv 


at ^o) is 2. A piece of surface is said to be analytic if it is 
analytic at each of its points. 

The extension of the definition to manifolds of higher order is 
obvious. 


1. Let 


Exercises 

1 

M = — 

r 

= (x — -h (j — })f -h (z — c)^ 

{a, hy c) ^ (0, 0, 0), r > 0. Show that the function u is analytic 
in the origin. 

2. L^t V 

M -JKx.y, z) 

be analytic in the origin. Then 


f{x, y, z) = Uoix, y, z) + Mj {x, y, z) + • • 

where Un {x, y, z) is a homogeneous polyno nial of degree n, or is 0. 
Furthermore, let u be harmonic : 

d^u , d^u ^ d^u _ ^ 

Show that Un{x^y^z) is harmonic. 
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§10. Regular Curves. Jordan Curves. We have defined 
analytic curves, and now mathematiciil perspective demands some 
mention of the more general concept of curve, even though a detailed 
analytical developement of these ideas lies outside the frame of these 
Lectures, 

Let 

1) r = ?(0i 
where fit), (pit) are continuous in the closed interval 

2) 0 ^ r g 1. 

Under suitable further restrictions Equations 1) will represent a 
cur\'e in the [x, y) - plane. Ijet us first, however, consider the pos¬ 
sibilities when no further restrictions are imposed. 

a) The point set \ (x, y) ) defined by 1) may consist of a 
single point. This is the case when f [t), ip (t) are both constants. 

b) At the other extreme, the point set { i^> y) } defined by 1) 

may fill a two-dimensional region of the (x, - plane. Peano has 

given an example in which every point of a square in the (x, y) - 
plane belongs to the point set j {x, y) It is only fair to say, how¬ 
ever, that the transformation of the interval 1) on the square is not 
one-to-one. Some points of the square are obtained more than once. 

In each of these examples the transformation of the points of the 
intei-val 2) on the elements of the point set j [x, y) j defined by 1) 
has failed to be one-to-one. Let us, then, with Jordan, seize on this 
requirement as the further restriction to be imposed on the functions 
f it), (p it) and say: — If j/, y are any two numbers such that the 
equations 

3) y=z^(t) 

admit a common root t = t^, where 0 <, <. 1, then these equa¬ 

tions 3) shall admit no further root t = t", where 0 ^ S 1. 

Such a point set { ix, y) j is known as a Jordan curve. If, in 
particular, 

4) /(0)=/(l), 9^(0) = 9^(1), 

the curve is closed, and it is a fundamental theorem of analysis 
situs that such a curve divides the plane into an interior region and 
an exterior region. 

But if Equations 4) are not both true, the end points of the 
curve are distinct, and we have an open curve. The curve is simple. 
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i. e. has no multiple points. For otherwise the equations 5) would 
admit two distinct solutions, and t", in the closed interval 2). 

Returning to the case of a closed curve we observe that there is 
a one-to-one and continuous relation between the points of such a 
curve and the points of a circle. 

4 Jordan curve may fail to have a tangant at each and every 
point. Moreover, there is another important property which it fails 
to share with the curves we ordinarily think of, like arcs of ellipses, 
cycloids, etc. or even arbitrary analytic arcs (or regular arcs, cf. 
infra). Any one of these latter arcs can be embedded in a two- 
dimensional region of arbitrarily small area. But it may be impos¬ 
sible to enclose a Jordan curve in a two-dimensional open set, the 
area of which is less than an arbitrary positive quantity — even when 
the “area” is measured in the sense of Lebesgue. 

Regular Curves. Consider an open Jordan curve. Impose on 
the still further restrictions that each of these fynctions 
possess a continuous first derivative in the closed interval 2). Such 
a Jordan curve is defined as an arc of a regular curve, or as a 
regular arc. 

A regular curve is now defined as the point set made up by 
stringing together a finite number of regular arcs, Cj, C 2 , • * *, Cn\ 
the terminal point of coinciding with the initial point of 
A = 1, 2, • • *, n — 1, 

A regular cui*ve may be open or closed. It is not necessarily 
simple. It may have a whole arc of multiple points. Or it may 
have an infinite number of multiple points, all but one of which 
are isolated ; e. g. ^ 

/ y = sin — , 0 •< x ^ 1; 

.r 

^ y = 0, X = 0, 

is a regular arc, -and 

j = 0, 0 ^ :r g 1, 

is another. Together they make up a regular curve. 

Evfrcise 

Show that a point set { {x, y) j consisting in part of a two- 
dimensional open set can never be mapped in a one-to-one manner 
and continuously on a line segment, 2). 



Chapter VlII 
Fourier’s Series 


§ 1. Fourier’s Series. By a trigonometric or Fourier*s series 
is meant a series of the form : 


1) 




+ (^n COS nx -]rhn sin nx). 


If the series converges and, after being multiplied by cos^a: or 
sinA'j:, can be integrated term by term, it is easy to determine the 
coefficients. Observe the formulas of integration: 


71 


sin mo: cos nx dx = 0 ; 


It 

—It 

/■ 


sin mx sin nx dx = X 


cos mx cos nx dx = 


0, m ^ n ; m = n. 


Thus we find, on denoting the value of the series by J (a:): 

:: 7t 

2) an ^ fM cosnxdxy = f{x)smnxdx. 


These numbers, and are known as the Fourier*s Coef¬ 
ficients of the function f (x). They have a meaning for any contin¬ 
uous function, and for a great variety of discontinuous functions, aside 
altogether from the problem of whether the function can be developed 
into a Fourier’s series or not. Let us study some of their properties. 

We shall restrict ourselves to func tions f{x) which are continuous 
in the interval (— ir, ir) except at most at a finite number of points, 
• * •, cf. figure on next page. Within each interval (xj^, ^k-hx) 
the function shall have a continuous derivative, and both function 
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and derivative shall approach limits at each extremity of the sub- 
interval. In a jioint a;*, 





where 

/(c+) = lirn fix), fic~) = lim / (ar). 

Jft=:C+ X=cr‘ 

Moreover, 

f{r) — i\fi — Tr+) +/(»•“) !• 

Thus y (x) is defined in the interval — ir <1 x = tt. For all 
other values of x it shall be defined by the requirement of periodicity : 

fix + 2t) =fix). 

We shall prove in §§ 7, 8 that such a function can be developed 
into a Fourier’s series. 

Exercises 


1. I ^et y (.r) be defined as follows : 

fix)=\x\, —r<x^ir-. 

/(x + 2ir) =/(x). 
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2. Let f {x) be defined as follows: 

f{x)=\, 0 < X < »>; 

/(x)= — 1, —r<x<0; 

/(O) = 0, /(r) = 0; 

/(x + 2»-) =/(x). 




Show that, if f (x) can be developed, 

4 
r 

3. If f (x)- is an even function 


, + /sinx , 


sin , sin 5a: , \ 

—i— + —ft— +•••!. 


f{-x)=f{x), 

•how that only the cosine terms will appear; 


/ W = ^ + X «n = — I fix) COS nxdi( ; 

2 »• 5 ^ 

and ify*(a:) is an odd function; 

/(-^)=-/Cr), 

only the sine terms will appear: 

y sin n r, ^ = — If {:v) sin nxdx 

4. If f{x) is defined merely in the interval 

0 ^ a: S IT, 

show that f{x) can be developed into a sine series, and also that 
f{x) can be developed into a cosine series. 

5. Ify^(a:) is defined merely in the inten^al 

0 X ^ 


and if 


/(ir-x)-/(x), 
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show that, ii f {x) be developed into a cosine series or a sine series, 
only alternate terms will appear: 

/U) = -r + X 

^ ns=tl 


fix) = X ~ 


6. Assuming that the functidn 

f (x) =■ cos a X 

can be developed into a Fourier’s series, convergent in the interval 
— IT X ^ ir, show that 


sin av i 1 , xT'licxcosnircosn^l 

On setting x = t the development becomes : 

sin (X IT r 1 ^ 2 ct 1 

cos a »• =-<-1- X —2 -T f • 

Changing the notation, we have the development: 

' V - 

JC' — 


T cot Trx = 


n=sl 


§2* Bessel’s Inequality. Normal Functions, \jet 
9x (a:), • ‘ • ,ipn{^) be a set of functions, each continuous in a closed 
interval a x ^ h, and such that 


3) 


J *Pm ix) <p„ {x) afar = 0, m ^ n. 

a 


Moreover, they shall be linearly independent. Such a system is 
called a set of orthogonal functions. As an example : 


V 2 n (-r) = cos nx, <p2n-i (•^) ~ ^in nx. 


It is in terms of orthogonal functions that the most important 
developments of mathematical physics take place: 

5) fix) --= Co tpo (x) + Cl (j:) + • • •. 
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If such a development is possible, and if on multiplying through 
by ipn{x) it is possible to integrate term by term, the coefficients 
will be given by the formula: 


h 

J" (^) 

a 

-- 

J* [<fn{3:)fdx 


Observe that the denominator cannot vanish, since no function 
can vanish identically. 

If <Pq (or), ipi (.r), •* * * is any set of orthogonal functions, then 
0^0^*1 * * *♦ where the a„'s are any positive constants, is 

also an orthogonal system. It is obvious that the can be so chosen 
that 7 , 


J* [<fnU)]-d:r= 1. 


The modified set of functions is said to be normalized. Thus the sot: 


1 cos nx, 


: sin nx, — ir < x < ir. 


is an example of a normal system. Equation 6) then becomes: 


i = J* f (^) U') 


Approximation hy a Normal Polynomial. How can we use 
the n coeflicients c* most advantageously, in order best to approximate 
to a given function, J (x), by a polynomial of normal tunctions, 

10) c^) f 0 U') + Cl f 1 (:r) + • • • 4- c«_i v'n-i (^e) ? 

The question can, of course, be answered in ineiny wavs. (3ne 
of the most useful answers is that given by Bessel, who used the 
idea of Least Squares and demanded that the c^s be so deteimined 
as to make the integral of the square of the error: 

h 

M [/(■■r) — Co V’o (•»•)—••• — C„_1 <fn-i {x) f llx 

a 
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a minimum. A necessary condition for a minimum is, that 

7 . 

-~^J -‘^n-l ^'n-1 ] f* = 0- 

a 

Since the <Pk{^) form a normal set, this equation reduces to the 
following: 

h 

11) ~ 

a 

These are the same values as those given by 9), and further¬ 
more it is to be noted that a given Cj^ does not change as n increases. 

If these values be substitued in the integral, the latter reduces 
to h 

J *[/W - Cl - • • • - cl-i . 

a 

But the integral is never negative, and so we arrive at BesseVs 
Inequality ; 

12) + c’l + • • • + g J [fix) fdx. 

a 

From 12) we infer that the series 

13) C5 -4- • 

converges. In particular, we see that the series formed from the 
squares of the Courier’s coelficients converge: 

r fly -f + ^2 + • • • 

14) j 

^ M + • • • 


Exercisi s 


1. Let ^(.r) be continuous in the closed interval a S x ^ h. 
Show that each of the integrals 

h h 

^ ip {x) cos nx dx, ^ ip (x) sin nx dx 

^ a 

approaches the limit 0 as n becomes infinite. 

Suggestion. Begin with the case that a = t, t. 
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2. Extend the theorem of Question 1 to the case that ip (a:) is 
continuous in the above closed interval except for a finite number of 
points, and ip {x) is absolutely integrable; i. e. the integral 

h 

J \<f{x)\dx 

a 

converges. 

Suggestion. Isolate the points of discontinuity by arbitrarily small 
neighborhoods. Show that the contribution of these neighborhoods 
is uniformly small for all values of n. Then apply the theorem of 
Question 1 to each of the remaining intervals. 


3. 


If ^ {x) satisfies the conditions of Question 2, show that 



sin (n + J) xdx = 0. 


§3. Appraisal of the Fourier^s Coefficients. If a func¬ 
tion f{x) of the class here considered (^1) has no discontinuities, 
the series 


15) 


( flo “h "b ^2 "h ' * * 
1 + ^2 + * * ’ 


converge absolutely, and so the Fourier’s series converges absolutely 
and unifonniy for all values of x. 

The proof is as follows. Transform the integrals in 2) by in¬ 
tegration by parts. Since J^(x) is continuous and periodic, we find : 


16) 


J f{x) cos nxdx 

—jt 





sin nxdx 


71 


sin nx dx 


7t 


J?) cos nx dx. 


Let the Fourier’s coefficients of the function f^{x) be denoted 
by primes: 

17) ah J* J* ix) cos nx dx, bh = ■— J* J* (x) sia nxdx. 
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Thus the relations 16) can be written in the form: 

bl . aL 


an - - 


r _ 

On — — . 
n 


We cannot integrate again by parts without making requirements 
respecting the second derivative of f (x). We can, however, attain 
our ends by means of an algebraic device. It is obvious that 

Hence 

^ b'^ + i . 

n rr 

But the series 

+ ••• 

converges by §2, 14); and the series 

1 1 

72 + 22 ' 

also converges. From 18), then, 

2 I 1 ^ b'^ + 

n 

and hence the first of the series 15) converges absolutely.—The 
convergence of the second series is shown in a similar manner. 

§4. Identical Vanishing*. VVe come now to a theorem which 
is proved with equal ease for a more general class of functions than 
that of § 1. 

Till:. Ri.M. Let <p{x) be continuous in the interval 
— ir <. X ^ Tj 

except at most for a finite number of points; and let the function 
be bounded. Let all the Fourier's coefficients vanish: 
r, re 

if (x) cos nx dx = 0, ^ if {x) sin nx dx = 0. 


Then ip (x) = 0, except in the points of discontinuity. 

Proof, If the theorem is not true, let x = X be an interior 
point of the interval, in which (p{x) is continuous and ^ 0; — posi- 
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tive, say: ^ (X) > 0. Then there exists an interval {a, b) j 
--T<a^x^b<T, 


where 


+ ft 


such that f (*t) is positive throughout («, ft), and is, therefore, greater 
than a certain positive constant, M: 

M < a ^ X ^ b. 


Let hi <. t/2 be so chosen that the interval | :r — X | ^ ftj 
lies in (fl, ft), and choose 0 < ft < Aj. Form the function 


C (j:) = y + cos 



and determine y so that 

C(ft) = l, 
or 

y = 1 — cos ft. 

Then C{x) has these two properties; 

i) 1 ^ CU). 1*1 g A; 


ii) -rSC(*)gr, 

— ir ^ a: ^ — ftj, fti ^ x ^ v, 

where r is the larger of the two constants 1 —- y and C(fti), and 
hence 0 < r < 1. 

And now we apply this function as follows. Let 
jy = c ( X — X ). 





y>{x) yd X, 


([Consider the integral; 
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where n — 2m is an even natural number. If m is chosen Jarge 
enough, the value of this integral will be positive. For, the integral 
can be written as : 

>+*i 

I (p{x)y^dx 


+ 



The first integral is greater than 



> 2Mh 


for all values of m. 

Let G be the upper limit of \<p[x) ] in the interval (— ir, t). 
Furthermore, if € > 0 is arbitrarily chosen, m can then be so 
determined that r” < c, and consequently 

jy'* < €, — T ^ X ^ \ or \ hi ^ x ^ t. 

Hence the second and third integrals, taken together, are less than 


Thus 


2 v G €. 

^ ^ W d X > 2 M h — 2 t G 


Let € be so chosen that the riglit hand side is j)ositive. 
Here is a contradiction, for 


J ^ X ■= 0 

for all values of n. In fact, 

j'* = [ y q- cos (x — X) 


can be written as a polynomial in sinx, cosx, and then converted 
into a trigonometric polynomial, cf. § 5: 

n 

^ {Ak COS kx + Bk sin Arx). 

kmO 


Hence 
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(p{x)cQskx dx 


7C 



But the Fourier’s coefficients of if {x) all vanish by hypothesis. — This 
completes the proof. 


§5. The Formulas of Summation. The following for¬ 
mulas of summation are especially useful in the study of Fourier’s 
series. 


f 


i + cos ^ + cos 2 ^ + • • • + cos n ^ = ■ 


. 272 + 1 
sin—— ^ 


A) 


2sm-^ 

ip 272 +1 

cos — cos- -J- -/ 


sin if + sin 2 ^ + • • • + sin ^ 




2sin-^ 


B) 


1 , . n . • cos 71 <r — COS (77 + 1)^ 

I + COS ^ + cos 2 ^ + • • • + COS 72 ^ = -—--r-^ 

^ ^ 2(1—cos^) 

, _ . since + sin/itr ~ sin(72+1V 

sin^P + sin2^+•• +8in72^=-2”(i-cosV)- 

These formulas can be deduced most expeditiously by the aid of 
complex quantities from the geometric progression ; 




- 1 


They can, however, once given, be established by the method of 
mathematical induction. 

Similar formulas for 


COS ^ — cos 2 ^ + cos 3 ^ — ••• 
sin ^ — sin 2 + sin 3 y — • • • 

can be obtained by replacing by y + ir. The denominator will 
be 2 cos I or 2 (1 + cos ^). 
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Other Formulas of Trigonometry, We mention de Moivre’s 
Theorem : 


^ m m(m —1) . 0 

cos mif cos'” (f - ^~ cos'” ^ ip sin^ tp 


C) 


1-2 

m (m— 1) (m—2) (m— 3) 

1-2-3-4 


cos'”""^ (p sin^ ip + 


m(m-—1) (m—2) . o 

sin m ^ = Tw cos'” ^ ^ sin ^-^- — - - cos'” ip sin^ ip 

1 • 2 • 3 




proved most easily by expanding the binomial on the right of the 
equation 

= (cos^ + isin^)”', 


and equating coefficients; also by mathematical induction. 
Furthermore, a quasi inverse: 

m 

D) cos^x sin^:r = {Ak cos^:r + 5* sin^x), p + q ^ m, 

kfsaQ 

This formula is likewise readily established by induction. 


Exercises 

1. Prove that 

. X . • f r» sin 2 n 

cos ^ + cos 3 ^ 4- • • • + cos (,2 71 — 1) ^ :- , 

2 sin <p 

. - x , .-70 1--COs27Z^ 

sin ^ 4- Sin 3 ^ • 4- sin (2 ti — 1) ^ = —--. 

2 sin ^ 

2. Obtain formulas for 

cos^ — cos 3^ 4- • • • 4- (— iy*^^cos (2n — 1)^, 
sin^ — sin 3y 4- • • • 4* (— sin (2 ti — l) ip. 
Suggestion: Write the odd numbers as 4^ 4* 1 and 4/i. — 1. 

3. Prove that 

(tt cos 4- 0 sin x 4* y)"* 
can be written in the form: 

m 

V {AkCO%kx 4- 5* sin Ax), 
iud 



232 


FUNCnONS OF REAL VARIABLES 


§& Abel’s Theorem* If the coefficients of a Fourier’s series 
form a series that converges absolutely, then the Fourier’s series con¬ 
verges uniformly for all values of or, as is seen from Weierstrass’s 
M-Test. In the case of certain other important Fourier’s series, the 
uniform convergence can be established by Abel’s theorem. Chap. V^, 
S 6. Let ai, oc 2 » * • ‘ be any set of numbers such that 

S ^ S • * * . lim a„ = 0. 

noBjo 

Then the series 

0-1 sin ^ + (34 sin 2 ^ -f- • * • 

converges uniformly in any interval (a, b) which with its extremities 
lies inside the interval 0 < x < 2 t: 

0 <. a ^ X ^ b <. 2 t, 

We wish to prove that, to a positive € chosen at pleasure, there 
<x>rresponds an m independent of ^ such that 

I am+i sin (m -f 1) -i* oLm^p sin {m + p)^\ < c. 


1 , 2 , ••• 

Now, by §5, A): 

sin (m + 1) + sin (m -h 2) ^ -h * • • + sin (m p)(p 


2 rn "b 2m 2 p ^ \ 

cos- - -- cos- ^ - if 


2 sin 




and so 


- — ^ sin (w + 1) ^ • 4- sin {m p)ip ^ — - 


sinf- 


sin 


JP- 


for all values of p. If, then, we choose c as any positive quan¬ 
tity < r, we shall have 

- - — ^ sin (m + 1) ^ -h • • • 4* sin -f- ^ ^ —-— , 

sinf sin| 

c ^ ip S 2 t c. 


Hence by Abel’s theorem 
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— c, 

and so it is sufficient to choose m so that 


The same theorem holds for the series 

ai cos ^ 4- 0*2 cos 2 ^ + • • •. 

A similar theorem holds for the series 

ai cos ^ — a 2 cos 2 ^ + 0*3 cos 3 ^ — • • • 

and 

ai sin ^ — a 2 sin 2 ^ + ct 3 sin 3 ^ • 

the interval {a^b) of uniform convergence now lying within the in¬ 
terval (— “T, »•): 


Examples, 


sin ip , sin 2 ^ , sin 3 ^ . 
1 2 "^3 


cos^ j cos2^ , cos3^^ 
— + ••• 


Exercises 


1. Prove that the series 


sin X , sin , sin 5a: , 
— + ~ 3 ~ + - 5 - + 


converges uniformly in any interval 

— or (^<,a^x^b<T, 


2. State and prove a similar theorem for the series: 

cos a: , cos 5a: , cos 5a: , 

—• 



234 


FUNCTIONS OF REAL VARIABLES 


§ 7. Proof of Conversfence. We have stated in § 1 the 

theorem that the Fourier’s series corresponding to a function ./’(a:) 
of the class there defined, converges for all values of the argument 
and represents the function; i.e. the value of the series is equal, for 
each or, to the value of the function. We will now prove that 
theorem. Begin with the case of no discontinuities oi f{x). Then 
the Fourier’s series converges uniformly for all values of x (§3)^ and 
so represents a continuous function, 

oo 

1) F(jr) == 4-^ (^rncosnx-h ^nsin wx). 

^ 71=1 


The Fourier’s coefficients of this function can actually be obtained 
by the method suggested at the beginning of § 1, and so we have: 

“H It 

2) ^ 71 = / F{x)cosnxdx, I F{x)smnxdx; 

T U T U 


i.e. the Fourier’s coefficients of the functions /(x) and F{x) are 
identical. 

Form the function: 


f’W =/(^) — 

This is also a function of the class defined in § I, and it is continu¬ 
ous without exception. Its Fourier’s coefficients aue all 0. Hence by 
§4 it is 0 for all values of x, and the functions fix). Fix) are 
seen to be identical: 


3) 




Thus the theorem is proved for continuous functions. 

§8. Continuation. The Discontinuous Case. A Special 
Function. The proof of §7 justifies the development of § 1, Exercise 
1. But we can go a step further and establish the development of 
Exercise 2. For, the first series can be differentiated term by term, 
by the theorem of Chap. V, § 9, at all points at which f (x) has a 
derivative. In faci, let xq be any point of the interval 0<x<»' 
or — S' ■< X <C 0. It is then possible to include xq within an 
interval (a, b) which, with its end points, lies within the interval in 
question: 
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— r<£i<xo <^<0 or 0<.a<,XQ<.h<,T, 
Within this interval the series 


sin X , sin ^x , sin ^x 


+ • •• 


converges uniformly; cf. § 6 , Exercise 1 . The other conditions for 
differentiation term-by-term are satisfied, and thus the developement 
of Ex. 2 is obtained. 


Oscillation of f{x) at a Point of Discontinuity, liet 
£)=/(c+)-/(c-). 

Then D is the oscillation of f (x) at the point c. 

I.et 

* / ^ 2 r sin .r , sin . sin , 1 

Then 

^ (a:) = -J, 0 < X < Tr ; 

(x) ~ — I-, —' -r < or < 0 . 

Thus the oscillation of ^ (x) at x = 0 is 1 . 

Form the function: 

fix) ^D<t^ix- c), 

vihere f ix) is a function of the class defined in. § 1, and D is its 
oscillation at c. This function also belongs to that class of functions, 
and its oscillation at c is 0 ; i.e. it is continuous there. 

Let the discontinuities of f (x) in tlie interval — tt < x ^ ir 
lie in the points 

— T < Cl < C2 <•••< Cn ^ TT 

and let the oscillation in Cj^ be Then the function 

fix) - 5 ; Z?* * u - c*) 

will be continuous for all values of or, and also belong to the class 
of functions defined in § 1 . It can, therefore, be expanded into a 
Fourier’s series, absolutely and uniformly convergent to the function 
for all values of x. 
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The function $ (a: — c) can also be expanded into a Fourier^s 
series whose general term is 

sin (2n — l)Cr — c) _ 

2 / 1-1 


■ sin ( 2/1 — 


and we know all about the uniform convergence of this series. 

We see, then, that the original function f{x) can be expanded, 
and the proof is complete. 

We remark that the Fourier’s expansion of the function, 


Hq ^ 

/ (x) = — + 2) («n cosnx + b„ sin nx), 

^ 71=1 

can be broken up into the series 


an cos /ix, hn sin nx. 

For, 

/(— x) = ^ + T («„cos nx — bn sin nx), 

^ n=l 

and the two series can be added and subtracted. 

The same result might have been obtained by observing that 
any function f (x) of § 1 can be written as the sum of an even and 
an odd function: 

/(x) = i[/(x) +/(—x)] + i[/(x) —/(—a:)]. 

Each of these functions can be developed into a Fourier’s series. 
The first development will contain only cosines, the second only sines. 

One further remark. A function f{x) of the class here con¬ 
sidered may vanish identically throughout any subinterval of the 
interval (—-r, r); but its Fourier’s coefficients will all vanish if 
and only if the entire interval is made up of a finite number of 
such subintervals and their end points; i. e. f {x) s 0. 

§9. The Gibbs Effect. When the Fourier’s development 
represents a discontinuous function, the series cannot converge uni¬ 
formly, since the terms are continuous. One might expect the 


X 
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approximation curves to proceed fairly directly, as in the case of 

_j_ 

lim X , 

/l=soo 

On the other hand, they might rise to indefinite heights, as in the 
case of 

lim 

ftsssao 

They do neither. The function s„(x) is bounded, but the graph 
rises appreciably above, and drops appreciably below, the graph of 
the limiting function near the point of discontinuity. This is the 
phenomenon which Gibbs first pointed out, and which B6cher was 
the first to treat mathematically*. We turn now to a detailed study 
of the phenomenon, following Bdcher’s methods, but using a slightly 
different series**.' 

We have seen that the function 


1 ) 


rf V sin X , sin 3 JT , 


has the value: 


2nr < X < (2n + l)r 
(2 n — 1 ) ir <. X <. 2 UT 
0, X = riT 

We wish to study the approximation curves and, in particular, 
to show that they remain finite. Let 


2 ) 

Then 


/ X sin X . sin 5x , 
U) = -J- + -^- + ' 


sin (2n — 1)3? 


2n - 1 


3) Sn (j:) = cos a: -h cos 3x -h • • * -4- cos (2 /i — 1) x = 


s in 2 / 1 X 
2 sin X 


Because of symmetry it is sufficient to study the function in the 


interval 
We have: 


0 ^ X ^ 


• Gibbs, Nature^ voT. 59, 1899, p. 606. Bocher, Annals of Mathematics^ 2d. 
•cr., vol. 7 (^1906) p. 125. 

•• This is the series used by Carslaw, Fourier's Series and Integrals. On 
p. 275 there is a carefully drawn graph of the approximation curve for a 
particular value of n. 



238 


FUNCllONS OF REAL VARIABLES 


4j 



s\n2nx , 

-- dx. 

2 sin:c 


This integral can be transformed as follows. Write : 


wliere 




Sin X 


5) 


2v^(x) 


1 

sin X 


\ 

X 


X — sin X 
X sin X 


0 <i X 


T 


Moreover, we define 

<p ( 0 ) = lim tp (x) = 0 . 

x=0+ 

Thus (p (.r), together with its derivatives, is continuous in the closed 
inteiTal 0 ^ x ^ i • 

We can now write: 


6 ) s„(x)= ^ dx -h ^ ^(x) sin 2 nxdx, 

0 0 

The second of these integrals can be appraised by integration by 
parts. Thus 

J! X 

( if {x) sin 2nxdx’=- — C (x)cos2nx dx, 

c/ 2 n 2n k) 

0 0 

Denote the value of this integral by ^ : 

❖ (r, n) =■ S if {x) fin 2 nxdx, 

0 

I-et yi be the maximum value of \ ip{x)\, ] <p^{x) ] in the interval. 
Then 

7) 'if (.x,n)\ ^ G = (i+ir)M, 0 ^ x ^ f. 

n 

Hence 

8 ) Sn{x) = C dx I ^ 1 ^ ~ , 0 < JT g f. 

J 2x n 

0 


This latter integral can be thrown into more transparent form 
by a change of variable. Set 
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9) 

Then 

10 ) 


2nx = ty 


X 


t 

Yn 


s 


sin 2nx 
2x 


t 



0 


This integral converges when t — oo. It is, in fact, well known 



0 


but we do not need the quantitative result to establish the truth of 
our statement, that the function Sn{x) is bounded. That proof is 
now complete, since 

t 

12) s„i,x) Jdt +, 

0 

and each of these functions is bounded. 

Remark. The reader who is interested in following the quantita¬ 
tive relations more closely, can readily do so. The ordinates of the 
curve 

13) y=s„{x) 

can be appraised with an absolute error of less than any preassigned 
positive € for large values of n as follows. First, determine m so that 

m 


Then the ordinates wdll be given to the degree ol accuracy in ques¬ 
tion by the integral 


X 


t 




t 


0 U 

In particular, the maxima and minima of rhc 
given by the roots of the function sl^{x)i 


curve 1^; aie 


V tr 

.ri = , xo = — , 

2n n 


•^3 


PIT 

Jn ’ 


^4 
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kT 

In any case, xjt = - 7 ^—. Thus 
2/1 



« 2n S9r Jri 

0 « 2n (Jt—1)11 

The terms in this sum are alternately positive and negative, and 
steadily decreasing in numerical value, so that the sum can be 
written in the form: 

i/Q — + t>2 — + • *' 

The values of the early VnS are found to be*: 

t;o= 1.852 1/4 = 0.142 

Vi = 0.434 V 5 = 0.116 

t/o = 0,257 vq = 0.098 

1/3 = 0.183 

§10. Integration and Differentiation of the Expansion. 

The series arising From the Fourier’s expansion of any function oF the 
class defined in § 1 can be integrated term by term throughout any 
finite interval. This is obvious when there are no discontinuities, 
for then the series converges uniformly for all values of 2 :, and the 
terms are continuous. But even when discontinuities are present, 
integration term by term is possible in any interval which does not 
contain or abut on a singularity; for in such an interval the con¬ 
vergence is uniform, and the terms are always continuous. Moreover 
the function 

i»(x) = ^ + X + ftnsinnx) 

is bounded. If, then, the points of discontinuity which lie in an 

♦ cf. Bochcr, 1. c., p. 129, where further references are given.—^The details 
of the study here outlined are given by Carslaw, 1. c. 
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interval of length 2r be excluded from the interval by arbitrarily 
small neighborhoods, the contribution of these neighborhoods both 
to the integral of the function and to the integral of the remainder 
rn M of the series : 

fix) = Sn ix) + rn (x), 
will be small, and hence 



or the integral of the series is equal to the .series of the integrals. 
— It is left to the student to put this proof into €-form. 

Differentiation, If fix) is a continuous function of the class 
defined in § 1 , and if its derivative also belongs to this class, then 
the Fourier’s series whir.h represents fix) can be differentiated term 
by term. For, the derivative ff ix) can be developed into a Fourier’s 
series, and this series can be integrated term by terrn. The latter 
series is a Fourier’s development for f ix). But the Fourier’s develop¬ 
ment of fix) is unique. 

A repeated application of this result enables us to establish the 
following nr ore general theorem. 

Tuforem. If fix) and its derivatives of the first n orders 
are all functions of the class defined in § 1 , and if f ix) and its 
first n — 1 derivatives are continuous for all values of x, then the 
Fourier s expansion of fix) can be differentiated n times term by 
term. 

Bocher has obtained a number of more general theorems relating 
to differentiation term by term, as well as to the development into 
a convergent Fourier’s series, in the article c ited in § 9. This article 
is of elementary character and affords an important supplement to 
the treatftient here given. It is based on Poisson’s Integral, the 
analytic treatment of which was subsequently simplified, without 
however, thanks to a remark of Professor Perkins, losing tiie advan¬ 
tage of a simple geo netric interpretation of the convergence on the 
boundary*. 


* cf. the Author’s Funhionenthearie^ vol. I, 5th ed. 1928, p. 669. 
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§ 11. Divergent Series. In the ancient days of modern 
science mathematicians operated with divergent series with a naivete 
vvhicii lost much of its charm when the more serious requirements 
of convergence became central in the thought of the age. Let us 
turn back lor a moment and see what were some of the things they 
did. 

Consider the series 

1 ) 1 - 1 + 1 - 1 + ••• 

It is no use to sum the first n terms (the men of that time never 
did!). But this series must have a meaning — so simple a series as 
that cannot be a no-body. Let us call its value x : 

Well, now we see that 

Ah ha! 

= 1 — a:, 

a: = J. 

I told you it had a meaning, and there it is: 

But you are not convinced by my logic ? How banal! How¬ 
ever, to humor you, Til give another proof. You admit with all 
your modem sophistication that 

1 ^ q. ^2 _ ^3 . 0 < :r < 1. 

1 4- ^ 

And you believe in limits. Very well. Let x approach 1 as 
its limit. You see now, do you not, that tlie left-hand side of this 
equation approaches the limit J — even Weierstrass would liave 
admitted so much. And every^ school teacher knows that “if two 
variables are always equal and eacli appmaches a limit, the limits 
are equal’’. So the right-hand side also approaches the limit J, and 
again we have: 
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The inathernaticians of that age may not have been rigorous, 
but there was a joy of living which the world can never afford to 
ignore. Their antics still amuse us; they can instruct us. Turn 
again to the series 1) and be modem; compute the sum of the first 
n terms. It is alternately 1 and 0 ; 

= 1, ^2 = ^3=1. S4 = 0, • • • 

Well, its average value is isn’t it? That’s something to go on. 
In fact, it is a great deal, for it gave Frobenius as far back as 1880 
(Crelle 89) an idea which can be foriiiulated as follows. 

Summahle Series, Let 

2) + tfo “F * * ‘ 
be a series, and let 

3) Sji ^ ai a^ -V an- 

Take the average of the first n SnS : 


4) s„ = £l±3-± + ^- 2 . 

n 

If Sn approaches a limit as n becomes infinite : 

lim Sn — c, 

then the series 2) is said to be summahle^ and the number c is 
attached to it as its value (sometimes c.illed its sum). 

If the series 2) is convergent, then c will be its value in the 
ordinary sense, or lim Sn ~ c. 

Apply this definition to the series 1) : 

Sn= -I . when n = 2 m 


m 


2m- 1 


when 


n = 2m — 1 


Hence 


lim Sn = i, 

n—x: 


and so ^ is the value assigned by this definition to the series 1). 

But there was a second argument of Friend Euler, why the 
series 1) must have the value \. us see what that view can do 

for us. Form the power series 
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5) ^0 -f :c H- <70^“ + • • • 

And now I say : If the series 2 ) w surnmable, the series 5) will 
comerge when \ x \ <, 1 : 

6) /(jt) = flo + aix + flo-f • • •. 

2'he function f {x) will approach a limit as x approaclws 1 » and 
the value of this limit will he tJie value^ c, of the summahle series 
2 ):' 

lim f{x) = c. 

From the definition of Sn it is easy to infer that 

So ~ 2 ♦So ““ 

Vo = 3 «S3 2 Ao, 

and, generally: 

7) — nSn — {n— 1 )Sn^v 

From this fortnula we read off at once the following 
Li MM A. If 

I 5„ 1 < G, n = 1, 2, • • •, 

then 

8 ) \sn \ <• 2nG. 

Let 

(.r) = <7o + -r + • • • + Un-i 

••• + -^nU) , 

n 

We pmceed to transtorm Sn W by a process similar to that used 
in the proof of Abel’s 'riieore.ii, Chap. V, .^6. From 3) we have: 

^0 ^ “ ^2 — ’ * *» ~ 

Sn ~ -Sj *f" (‘^2 *** “f" (-Sn l) 

~ S ^ j:""' 

= (1 — 


Ilence 
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The iniinite series 


lari < 1, 


converges because of 7); and likewise the term approaches a 

limit, namely, 0. Hence the series 5) converges when \x \ < 1 , and 

9) fix) = (1 — x) ^ s, x'^K 

ve=l 

Neiv Proof of AbeVs Theorem. From this last equation we 
readily infer Abel’s Theorem. For, if lim Sy = c, then 


Hence 


and so 


c—€ < 5v< c + €. 


ic - c) -f — g X ^ (c + c) -r— 

ic — ^ (1 — x) s,x''~^ = (c + €)x"’~^ 


(1 — *) 


41 ^ c. 


Thus from 9) 


Hence 


fix) = (1 - x) X s,x''-» + (c + C) 

V==l 

n 

fix) — c = (1 — x) — c (1 — + C 


In this equation rests the proof. For 

1 C 1 < €, 


where m is already fixed, and | .r [ < 1. And now each of the 
first two terms on the right can be made numerically less than € in 
absolute value by restricting x to a suitable interval, 

1 — S < X < 1 . 

Hence 

|/(x)-c| < 3e, 0 < 1-x < ^. 

Thus 

oo oo 

lim 5 ) ^ 

0 »—0 
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We return now to the proof of the main theorem. From 7) 
it follows that 

^ [m S, - (v - 1) 5,_i] 

i;=al 


m-i 

= 5^ x'^) + mSmX"'~^ 

m-i 

= (1 “ *)X TnSm3^~K 

vel 

Since 2) is summable, 

|5n| < G. 

and so the last term on the right approaches 0 when m = oo 
( l^l < 1). For the same reason, the series 

1^1 <1. 

V«1 

converges. Hence finally 

10) f{x)=(i-^xff^vS,x^-K 

V—1 

The last step; 

lim fix) = c, 
ai=t- 

can now be taken exactly as in the proof of Abel’s Theorem just 
given. Since Sn approaches c. 


Hence 


c— c<5v<c+€, m S V. 


(c — c) ^ vS^/x'^^ ^ X 


or 


11) ySv*”"* = (c + t) 5) * 111 § €. 


Observe that 


1 


(i-*j 
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and write as a nutter of notation: 

m—1 m-1 

A='^ vS,x''-\ S = 

.v=l 

Thus 


^ vS^x'^^ 

\^s:m 

= V V 5»x^~^ — ^/ = 

/(■r) 

- A. 

— K OyC. yi —- 

(1 - a:r- 

\iBsm 

= ]^vx-‘ -B = 

v«=t 

1 

(1 - x'f 

- B. 


Equation 11), multiplied by (1 — x)-, now gives, because ot 10): 
/(x) — (1 — xfA = (c + t) [1 — (I — x)- 5]. 

Hence 

/(x) - c = t + (1 - x)'^A- {c + 0(1 - 
Since A and B are polynomials, they are bounded in the interval 

0 ^ JT < 1 : 

\A \ < M, \B \ < M, 0 ^ X < \. 
Consequently 

1 (1 - x)2^ - (c + 0(1 -^rfB\ ^ (1 + ;c| + €)M(1 - .r)2. 

This last quantity is s nail for values of x near unity, or 

(1 + Icl + €)M(1 - x)- < €, 1 - ^ < X < 1. 

Hence 

l/(x) - c I < 2c, 1 - (f < X < 1, 

and this completes the proof. 

§12. Summable Fourier^s Series. Let /(x) be continuous 
for all values of x and let f{x) have the period 27r. Fonn the 
Fourier’s coefficients and write down the Fourier’s series : 

-h {^n COS nx + bn sin nx), 

/ 

This series does not in general converge. It is, however, surnuiable. 
to the value f (x), as we will now prove. liCt 



248 


FUNCTIONS OF REAL VARIABLES 


Recalling the expression for the Fourier’s coefficients, §1,2), we 
see that 

Sn (^) = — ^/(O [ i + cos "h cos 2 (f — ^) 4- • • • 

4- COS (n — 1) (^ — j:) ] dt. 

The series in the bracket can be summed by Formula B), § 5, 
and thus s„ (x) takes the lorm; 

S„ix)=r4- f fit) ~ ~ dl. 

2Tr J 1 — COS (r — x) 

~:c 

It is now easy to compute the value of 


5„U-) = iLM±i:i±i»M 


We find: 




1 — cos n (t x) 


■ cos (^ — ^) ] 


Make the change of variable: 

t — X 


a 


r = .r + 2a. 


Then 


2 

1) 6'„(.r) =■:=-- f f(x + 

T ,J n sill'a 


Lenuia. f^et <p{oi) bej:ontinuous in the interval 


awl let c(a) approach a limit when a approaches 0: 

lim ip (a) = c (O"^). 

OUsiO*^ 


lini 



U 


sin^ ng 
n sin“tt 



Then 
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Similarly, 

lim f = 

riM J nsirroi 2 

if <p{o^) is continuous in the interval 

- f ^ a < 0, 

and ip (cl) approaches a limit when a approaches 0: 

lim ^ (a) = ^ (0“). 


Proof, Observe that 


C -2-= 

J n sm'^ a 2 


For, let 


(Tjt {x) = J + cos a: + cos 2x -h * • * + cos (A- — \) x. 


Then 


and 


sm^na 


= — [a-j (2a) + • • • + a„ (2 a.)] 

nsin*a. n 


V 

I* <ri(2a)</a = 


Let 


f («•) = (O'*’) + t. 

To an arbitrary positive e corresponds a positive S such that 

! C I < €, 0< a. < S. 

On the other hand, C is bounded, and so 

\i\^ M, 0 < 0. g f. 

We can now write: 

i F 

r =v>(0+) f^!^da. 

J ^ 'nsin^a. ^ J nsm^o. 
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, f . sin-«a , , / .sm“/ia , 

J 71 siTi- a ,7 77 sin^ a 

0 0 

rile fiibt iiitegiMl on the right has the value t / 2 . The other 
two ran he a[)prcused as follows. 



1 

1‘ (. f ' i 

M € f 

//sura 

n sm- a 

0 1 u 

0 


/ 


* sm- n CL j 

i —T-o— d CL 

n 


-S 


1 Sin- 
n sin- a 


d(L < 


IT M 
2 n sin^<y 


Now, € and S are fixed. Choose m so that 


Then 


< € 

2 m siiriy 


I < r^+l) 

j ,7 71 sin-a 2 i ^2 / 




m = 


and the first part of tlic lemma is proved.—The se.:ond part follow's 
lioin the first by a mere change of variable, ^ = — a. 

'l\irning now to Equation 1) and applying the liemnia, we see 
that, lor an arbitrary choice of x, the variable Sn{x) approaches a 
limit, and 

liin S„{x) =f{x). 

nsssx 

'I'llis proves the theorem. 

irffiendizations. It is evident that the above proof ajiplies to a 
nmch nioie general class of functions. In fact, let f{x) be any 
film tion which is continuous at a point x =■ x\ and is integrable 
and is siK.h that the Fourier’s coefficients have a meaning, and that 
moreover the ajipraisals used in the proof of the Lemma apply. 
Tlien the Fourier’s series is suinmable at the point od to the 
value 
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In particular, if f{x) has only isoltited discontinuities, at each 
of which both the limits 

lim /(x) (c'*’), lim /(x) =/(c~) 

*=c— 

exist, and if 

/(c)=i[/(c+)+/(0]. 

then 

lim S„{c) =/(c). 

n—oa 

Uniform Siimmability, Returning now to the case that f{x) 
is everywhere continuous, we see at once that f{x) is uniformly 
continuous for all values of x. To a positive € chosen at pleasure 
there corresponds, then, a positive S independent of x, x' such that 

|/(x)-/(xO I < e, |x-x'l<-r 

On using this S the foregoing proof shows that the Fourier’s series 
is uniformly suriimable to the value /(x). 

§13. Concluding Remarks. A Clamcal Convergence Proof 
Dunham Jackson has given to a classical convergence proof a parti¬ 
cularly simple form. Let f{x) he continuous in the interval (-—ir, ir) 
except at a finite number of points, and let fix) be absolutely 
integrable there; i. e. 

TC 

f l/(a:)|dx 


converges. Let f{x) have the period 2ir ; 

/(x + 2ir) —f{x). 


At a point x = ^ let 

i) 


lim /(x) =/(€■*■), 

4:=sP+ 


and let the difference-quotient 

in /U+A)-/U-^) 


0 < A < 


be bounded. 

Consider the Fourier’s series of this function. Let 
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1 ) 

Then 

Let 

Then 


^/i W = + 2) cos A.r + bk sin kx). 


k=»i 


*n (*) — — ^/(t) [ i + cos (t — ar) + cos 2 (f — 4?) + 

—7S 

+ cos w (t — x) ] iff. 

"■n (a:) = i + cosx + cos 2x + • • • + cos nx. 


•rn(x) = 


2n + 1 _ 
2 

2sin|- 


Sn(x) = -^ J*/ (t) (T„ (f — X) dt. 


Set 

Then 

2) 


jji W = J*f{v + or) V„.{u) du. 

BreaX this integral up into 

0 7t 

’> /+/ 

0 

and consider 

n 

4) /(u + x) (r„ (m) if It 


Observe that 


Hence 

5) 


7 /^ 

■^J*/(n«r„(«)ifn = -j/(5+). 


Thus 
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6 ) ■^J*/(u + i)(r„(u)du-Yf(i*) 

0 

= 1 “ sin (n + J) udu. 

tJ u 2smju 

0 

This last integral approaches 0 as n becomes infinite; §2, 
Exercise 5. Hence the left-hand side of 6) approaches 0, and we have: 

7) lim — C f{u i) an{u)du=^^ fix*). 

0 

If we replace the condition i) by the requirement that 


i') 


lim fix) —/(£~); 
;Cs=*5"" 


and if, instead of iil, we write: 

iiO 


S <h<Q, 


fil +h)- /(£-) 
h 

demanding that this difference-quotient be bounded, it then follows 
at once that 

0 

1 

8 ) 


lim-i- f fi.u + x)<r„{u)du = ^fii~). 

n=v> VO 2 


On combining these two results, assuming that both Conditions 
i) and i^) are fulfilled, and likewise ii) and ii^), we see that the 
Fourier’s expansion converges at £ to the value 

+ /(£-)]. 

If /W is continuous at £, the series converges to the value/(£). 
We have thus proved the following theorem. 

Theorkm. Let f{x) be continuous in the interval ( —ir, r) 
except at most for a finite number of points^ and let f{x) he 
absolutely integrahle: 


/l/C 


\x) 1 dx 


converges. 


Then the Fourier's series converges toward the value of the fiatc- 
tion in each point in which fix) has a derivative. 
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More generally, let the condition of differentiability be replaced 
by the requirement that the limits 

li.-n f(x) =/(£+), liin f{x) =/(£“) 

X-i;~ 

exist and the difference quotients 

/(t h)-f{y)_ 0<t<,, /« + 

h h 

be bounded. Then the Fourier*s series converges toward the lvalue: 

H/a+)+/(n]. 

Evaluation through Complex Variables, Consider the following 
development in the complex domain: 

1) log I ^ = + + «=• re^K 

I — Z ' 5 D / 


t-Flaru 



I'he circle of convergence is the unit circle. The series converges 
in every point of the circumference, except z = d: I, to the value 

n , cos 30 , cos 50 , 'X 

Hco*^+-y- +-5—+ •••) 

+ 2t(sm0+iil^ + •••). 

Since the function is continuous there, the value of the func lion 
and the value of the series are the same, by Abel's Theorem, Chaj). 
V, § 6. Now, the angle of the argument of the function is 

AC — \(/^==2» O<C0<ir; 

arc (1 4- 2 ) — arc (1 — z) = ^ 

VAj/- — .g, —■r<0<O; 
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and this is the coefficient of the pine imaginary ])art of the log¬ 
arithm : 

log (.V -F Yi) - i log + y “) + i arc {X + }7), 


lf>g [ ^ (cos @ 4* i sin ©) ] — log R + @ i. 


Hence 


sin 0 , sin 3d , sin 5d ^ 

2} — + —y- + + 


J IT, 0< d < T ; 

0, d := 0 ; 
i IT, — ir < d < 0. 


In conclusion, an appreciation of the role which Fourier’s series 
have played in the developement of modern mathematics is found in 
the retiring address of Professor Edward Burr Van Vleck as Vice- 
President of Section A, A.A.A.S., published in Science, vol. 39, 1914. 


Exercises 


1. By means of the development: 

log (1 +z) = z- — + 


show that 


^ « sin 2 d , sin 3 d 

_ = sm0-— + — 


2. From tlie series of Question 1 show that 
— d • n , sin 2d , sin 3d , 


IT < d <C r. 


0 < d < 2: 


3. From 4) and 5) deduc^e 2). 

4. Let f (x) be continuous in the interval 

0 ^ X ^ ir, 

and let f{0) = 0, f {tt) = 0. Let f{x) have a continuous first 
derivative except at a finite number of points, at each of which it 
approaches a limit from above, and also a limit from below. Show 
that the series 

sin nx, ^ C fix) sin/i-r dx. 
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defines a function, m= F{x^y\ continuous in the region 

oo, 

and satisfying Laplace’s Equation: 

d o oo 

li* 4.il“ =0 

ox' oy 

at all points (x, j ) of ihs region, for which 0 < y. Moreover, i< 
takes on the bound.irv wiliies 


and 


i) 

F(0. r) = 0; 

ii) 

F {T,jr) = 0 ; 

iii) 

F{x, p)=/(.-r); 

iv) 

liin F (x, y) — 0, 




no matter how x vaiies. 

5. Consider the region 
R : 0 ^ X ^ T, 


0 ^ t <. oo. 


Lety'(.r) satisfy the satre conditions as in Question 4. Show that 
the series 


b„ sin M-r, 


2 p 

bn = — / f(x) sin nxdxj 
defines a function u = F (or, t) which satifies tlie Heat Equation: 


d u __ 2 
d t ^ dx^ 

at all interior points of R and also in the boundary points 

.z: = 0, 0 < f < oo and x ir, 0 < ? < ocj. 

Moreover, u takes on the boundary values: 


and 


i) F(0, 0 = 0; 

ii) F(ir, t) = 0; 

iii) F(x,0)—f{x), 

iv) liin F(r, t) = 0, 


no matter how x varies. 
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6. I/et it be required to solve the Ue.it Equation • 

du _ o d-u 
dt ~ a? 

in the region 

R: 0^^<oo: 

M = $ (-E, t), 

subject to the bouadary conditions 

i) (0,0=0; 

ii) =c; 

ill) 0) —ip[x)\ 

iv) ^ (x, co) = 0, 

where <p(,x) is continuous and V’(O) = 0, fp(ir) == c; moreover, fp{x) 
shall have a continuous derivative except at a finite number of 
points, at each of which the derivative shall approach a limit from 
above, and also a limit from below. 

Show that this problem is referred to that of Question 5 by 
setting 

c 

fix) =<fix) - X, 

TT 

^ix,t) = F(.v,t) + — X. 



Chapter IX 

Definite Integrals. Line Integrals 


§ 1. Proper Integrals. Continuity. Consider the integral 

A 

J f{r,a)dx. 

a 

If WO impose on the lunrtion merely enough conditions to 

insure the (onvergence ot the integral, the fuiK tion c {cl) represented 
by the integr.d • 

A 

V’ («-) = J /(^. «•) 

a 

will have no properties; i.e. it may he any I unction whatever. For, 
choose v|^ (a) arbitrarily, and set 

/U,a)= 

b — a 

Then 

h 

f («-) = J* dx (a). 

a 

We will begin by restricting the integrand as follows. 

Thkokf.m. Lft the function f {x, cl) be continuous in the closid 
region: 

R: a^x^b, 

Then the function ip {cl) defined by the integral: 


1} 


A 

?■(«•) = f f{x,(t.)dx, 

a 


will be continuous in the closed interval 

AS a. ^ B. 
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Geometrically, the truth of the theorem is at once obvious. 
For, represent the integrand 
by a surface; 

2) z=f{x,(t). 

Cut the surface by the plane 
a = tto» where ao is any 
point of the interval B). 

Then the value of the in¬ 
tegral, or ^(ao), is given 
by the area under the curve 
of intersection ot the plane 
with the surface. 

Next, cut the suriace by the plane ct = olq + Act. The value 
of the integral, or ip (ocq -f- Aa), is now represented by the area of a 
near-by curve, and so does not differ much fmin the former area. 
Hence ^(a) is continuous. 

The arithmetic prool is as follows. Since f{x^a.) is continuous 
in the closed region /?, it is uniformly continuous there. To an 
arbitrary positive €, then, there corresponds a positive d, independent 
of (jT, oc), Cr', a') and such that 



|/(.r, a) —/(x', a') I < c. 


( < S 

1 I a — a' 1 < S 


provided (.r, a), ol^) are in R. Now form the difference : 


h 

V>(ao + Ao.) — ^oCtto) == J* t/U. <*-0 + Aa) —f{x, a^) 


dx. 


Let Aa be restricted to the interval 1 Aa | < <1. Then 


l/(a:,ao-h Act)-/(a:,ao) I < €, 


and so 


/» 

!y (o-o + Aa) — ^p(ao) I < i.dx = {b~a)t, lAa|<^. 

a 

This completes the proof. 
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Exebcises 

1. Criticise the following proof. “In the equation: 

/. 

y (cto + Act) — V? (fto) = J* i/(^. *0 + Aa) —/(x, tto) ! 
a 

let A a approach 0. Since 

lim j/(x, 0.0 + Att) —/(x, ao)! = 0 

the right-hand side approaches 0. Hence the left-hand side approaches 
0, and the function ^(ol) is continuous.” 

2. Prove that 


/ 


y(ar,a) fix 


is a continuous function of (a,x, £), where a.) satisfies the con¬ 
ditions of the theorem, and a S x S b, a ^ ^ ^ h. 

3. By rneans of the equation 

X 

^ dx * 0 < ar, 


prove that 


lim —? = log 


0 < {. 


4. Let /(a:, (x) be a function which, for each a. of an infinite 
point set is continuous in the closed interval 

a X b. 

Let Aq be a point of condensation of A., but not necessarily a point 
oi A. Let / (j:, a) approach a limit when (a:, a) approaches {xq, ao), 
where Xq is any point of the interval (a, b). Then the function 

b 

f («) = J f ix, a) dx 

a 

approaches a limit when a approaches ap. 

Moreover, the function 

lim J (xy a) = 0 ) (x) 

is continuous in the interval a ^ x ^ by and 
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Succinctly, then. 


lim <p («) ■■= 

01-—OlQ 


h 

03 CO 


dx. 


liin 

a^BOo 



dx 



§ 2. Continuation. Several Parameters. The integrand may 
depend on several parameters: j{x, aj, ao, * • •, a„). Let (ctj, • • •, an) 
be any point of a closed region B (Chap. Ill, § 1) of the n-dimensional 
space of the a’s; and let x lie in the closed interval 

a X b. 

Let /(x, ai, • • ^an) be continuous in the closed region thus defined 
in the {n + 1) - dimensional space of the (.r, a^, • ••, an). Then 


h 



a 


is continuous in B. — The proof is essentially the same as in the 
earlier case. 

Multiple Integrals. I^t r be a region of the (x, z)-space, 
and let f{x,y, z, a^, • * aO be continuous in the region R of the 
(3 + n)-dimensional space defined by r and B. Then the triple 
integral of extended over r, defines a continuous function of the a’s: 


2) 


^(aj, •••,«„) = J J*J* a-i. • •-.111) dr. 


where <p (cLi, • • is continuous in B, 

Of course, a similar remark applies to double and surface integrals 
oil the one hand : 


3) •••,<*>») = J"J‘ f{x,y,v.i,--,a.n)dv 

and to m-fold volume or (hyper-) surface integrals on the other: 


4) y>(ai, • •-.ttn) 


tJ 


f (-^ii * * *» ‘ I ct/i) dr\ 


the function ^(a^, •• '.an) being in each case continuous in Z?, and 
J continuous in K. 
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I’or example, consider the integrals that define a Newtonian 
potential function: 


5) 




(TdS 

r 


and S here denoting the region r or or, and /», cr meining the 
volume or the surface density, "fhus 


{x — a)- {y ~ £>)- + (z — c)-, 
P = P *). V = a (.c, y). 


or, in the case of a curved surface S, cr is a continuous function 
on S. 

The Iterated Integral, It is precisely these theorems that are 
needed to complete the proof of evaluation of the multiple integral 
by means of the iterated integral*. Thus in establishing the evalua- 
tion: ,, y, 

6 ) J J f{x,y)dS=J dxj f{x,y)dy, 

S a Vi 

it is essential to know that the first integral, 

Y2 

7) J f{x,y)dy, 

rt. 

is a continuous function of x, and this brings us to the last of the 
generalizations, namely: 


Theokkm 2. Let f{xy a.) be coniitinous in the closed region 

R : a X ^ b, A ^ CL ^ B, 

where 

(a), b - (o (a), \j^ (a) < co (ot). 

and \|r (a), oo (ct) are any functions continuous in the interval 
A ^ CL ^ B. Then the integral from a to b^ of the function fy 
is a continuous function of a: 

8) f (a) = I f{x, a) dx. 


* cf. The Author’s Advanced Calculus^ p. 260, and the Funktionenthecrie, 
voL I, 1928, p. 118. 
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Here, again, the intuitional proof by geometry— the area under 
the surface, § 1 — is suggestive and convircing — as convincing as 
intuitional geometry can he. 


a 



..5 

1 ..«. 


Wr 

o 


N_^ 

1 1 

X 


The analytic proof is simple. Make a change of variable: 


Then 


t = 



9) 



a) t + fl, a] dt. 


The latter integral represents a continuous function by Theorem 1, § 1. 

The extension to the case of n parameters, (oti, • • ^an), considered 
in a region J3, is immediate, the proof requiring no modification: 


10) f{x,ai,-”,a.„)dx, 

a 

= • ••.««). b = • •,*») < «(ai, • 


§3. Differentiation. Leibniz’s Rule. Consider the differ- 

entiation of the function 

h 

1) <p{a.)~ J* f{x,a,)dx. 

a 

Form the difference-quotient: 

, <r (tto + Aft) — c (ao) P + Aa) — f(x, an) , 

^ -J 

a 

If the partial derivative o[y(x\a) with respect to ol exists: 

Hm ccq + Aa) - f(x,ao ) _ £/ ^ 

0 Zk(X ^ (X> 
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the integrand approaches a limit when Act approaches 0, and it v^a^ 
formerly considered self-evident that 



a 


or that the definite integral can be differentiated under the sign of 
integration. The formula 2) is known as Leibnizes Rule, 

Here is, of course, a double-limit fallacy. What we want is; 


lim or lim C dx, 

Aa»0 Aa*=0t/ 

a 

and what we have found is: 


?, 

f lim /(^yfto + A*) -/Uftp) 


dx^ 


or 



dx. 


Nevertheless, under suitable restrictions, both limits exist and the 
two are equal. 


Thf.orem. Let fix^cL) be a continuous function of x in the 
closed interval a ^ x ^ b, a having any fixed value in the in- 
terval A ^ ^ B, Let df/dcc exist at each point of the region 


R : a ^ X ^ b, A ^ a S B, 

and let the function 

be continuous in R. Let 


f(«)= f f{x,a.) dx. 


Then 4f(a) has a derivative^ given by Leibniz's Rule: 


dip _ 
da* 


dx^ 


and is continuous^ A ^ a ^ B. 
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By the Law of the Mean 

+ A®*) —/(^,cLo) = Aa/fltCr, ao 4- 0Aa), 0 < ^ < 1. 

The function is uniformly continuous in R. Hence to an 

arbitrary € > 0 corresponds a if > 0, indei)endent of {x, a), (.r', a'), 
such that 

I/a (a:, «•)-/« (a:', a') < €, ^ A I < J 


C\x~x>\< 
(. I a — tt' 1 < 

^(«o + A O') - «■(«•()) /• z’ / .A. V. 

- ^ - =1 J»\x,a.a + 9Aa.)dx, 


It follows, then, that 


<p (tto + Aa) — c5 (o-o) ^ , 

^-A^^- J 


/• h 

J I/b(j ?,«’0 + Att) —/a(.r,«-o) I < J i. dx — [b — a) €, 

« tf 

provided 1 Aa [ < This proves the theorem. 

The extension to the case of several parameters and multiple 
integrals is immediate. Let r be a closed region of the {xi, • • •^XmY 
space; B, a region of the (a^, • • •,a„)-space, and let Xm> 

c**!* • * W'n) he defined in every point of* the region K of the 
(arj, • • •, Xm* an)-space determined by r and B. For an 

arbitrary point (a) in il let f be continuous in r. Then the integral 
of y*, extended throughout r, defines a function ip of the (a): 

ip (oti, • • •, a^) ^ * * ’» <*•!» ' * *» (^n) 


ip (ttj, • • 

■ I tt/i) — 

Let 

g/ 


3a.* 


exist and be continuous in the interior points of the {m + 7i)-diinensionaI 
region R, and bounded. Then tp admits a partial derivative dip/dcLj^, 
given by Leibnizes Rule; 

r... 
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and the function 


-(«'!» • • •, O'/I) 


is continuous in B, 

Example, Consider the potential: 

T 

S 2. Hence, 

p{x — a) dr 


"-Iff 


etc. 


Further, since \/r is a solution of Laplace’s equation, 

af = -^—5' + -^—5- -h -ir-TT = 0, 

a j:- a z- 

it follows that u is, filso. For 




Exerctse 

Differentiate the integral: 

r dx 

J 1 + X + 0,2 

0 

by I^ibniz’s Rule, and verify the result by direct computation. 

§4* Variable Limits of Integration. Theorem. T.et 
f [x^a^) be defined in the region 

R : a ^ X ^ b, A ^ Oi ^ B, 

a^^{(x\ b = (o((t)y \(/'(a) < to(a), 

where (a), co (a.) have continuous derivatives in the interval 
A ^ OL S B, Let f{xy(K) be continuous in x for each value of 
a: ^ X b. Finallyy let 
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exUt at every point of R not on the boundary « — vl/- (a), h ^ (a (a), 
and let fa.{x,ai) he continuous on the boundary. Then the function 

h 

c-(a) = f{x,<i)dx 

a 

admits a derivative^ continuous in the interval A ^ cl ^ and 
given by the formula : 


dip 

dcK 




da 

da. 


The prool: is simple in rase the definition of the function can 
be extended to a somewhat larger region, 

A': a ^ X ^ b, A ^ a ^ B, 

<2 = (o.) <. yjc (a), b = coi (ct) > co (a.). 

P^or then we have: 

^0 

^ (ao 4- Aa) — ^ (cto) = f/(^, clq + Aa) — /(.r, ccq) ! 

^0 

ao 

+ ^ f (.r, ao 4- Aa) dx 4 (a:, ao + t^a.)dx. 

bo %+Sci 

The first integral can be treated as in § 3. The second can be 
appraised by the Law of the Mean for integrals: 

bo+Sh 

f /(x,tto + i^a.)dx = Afe/(X,tto + 

where A" lies between bo and bo 4- A^. And the last integral can 
be represented in a similar manner. Thus 


*0 

=f fa(r,a.o + Aa) dx + 


^/(X.ao + Aa) - + Aa). 
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lim X — bo, Jim X' = a^, 


and the completion of the proof is now easy. 

When such an extension of the definition is not obvious or 
possible, the above proof can be modified without great difficulty, hut 
there is a simpler treatment, which we will not undertake to repro¬ 
duce here; cf. the Author’s Fiuiktwnentheorieo vol. I, 1928, p. 122. 
On the other hand, if one adds to the restrictions on the 

requirement of the existence and continuity of df/dx^ the transfor¬ 
mation of the variable of integration used in §2, whereby 





leads at once to a proof. 


§5. Iterated Integ^ral with Constant Limits. Theorem. 
Let f{xo.y) be continuous in the rectangle 


A: 

Then 


a ^ X ^ b, A S y S B. 

h B B h 


S J*f{x,y)dy=J‘ dy J*f{x,y)dx. 

a A A a 

It is possible to give a simple proof of this theorem without 
recourse to the double integral. Form the function 

* y: 


— J dx J f{x,y)dy. 


The function 


J f^x,y)dy 

A 

is continuous in A, cf. $1, Exerdse 2, and it has a continuous 
derivative with respect to y. Hence by §5 

^ V ^ “J fix,y)dx. 
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Thus 


and 


B 

I f y) ~ ■8) — Px {x. A) 


1* -o 

f f{x:,y)dy - 

a A 

F{b, B) - F{a, B) - F{b, A) + F{a, A). 


Because oF the syniinetry in the result it is obvious that the 
iterated integral taken in the reverse order has the same value, and 
this roiiipletes the prooF. 


§ 6, Proof that U = F {x, y) be continu¬ 
ous in the neighborhood of a point (j:o» jy©)- the First partial 

derivatives exist and be continuous in this region, and also the second 
partial derivatives in question. Choose a rectangle R, § 5, containing 
the point (;co» yo) in its interior and itself lying wholly within the 
above neighborhood. IjCt 


1) 


^ y) == 


and compute the* integral : 


2 ) 


^ {xy y) dx I ^ < 


d^u _ d^u_ 
dxdy dydx 

a ^ i <. X ^ b 
<, y ^ B 




d^u 

dydx 


dx. 


\ ^ 

Its value by § 5 is: 

3) 

Each of these integrals has the value: 

F{x,y)— F{i,y) — F(jr, q) + F(4,q). 

Consequently the integral 2) has the value 0, and hence the function 
^{x^y) vanishes identically. For, if (a:, were positive (negative) 
at a point within H, the limits of integration in 2) could be so 
chosen that the integral 2) would be positive (negative). It follows, 
then, that 
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§7. Improper Int^rals.* Consider the improper integral 


1) J*f(x,a.)dx. 

e 

The integrand shall be continuous in the region 

R: c S X < oo^ A S ou B, 


and the integral shall converge for all values of a in the interval 
{A^B). Thus the integral defines a function of ct: 

00 

2) ^ (a) = J* fix, 0.) dx. 

C 

The function ^(cl) is not, however, in general continuous. For 
example, the integral 


o?e-^*dx 

0 

converges for all values of ot. Its value, y>(a), is 1 when a ^ 0; 
but when a = 0, it vanishes: 


^(a) = 1, a 0; if (0) = 0. 


Its graph, — 
is a line parallel to 
the axis of a and 1 
unit above it, except 
when a = 0; then it 
drops to the origin. 



Again, consider the integral 


4) 


oo 

'!'(«■)= J* a 




This integral converges for all values of a, and 

yfr (cl) = tt. 


• The following treatment presupposes the ordinary tests for convergence 
as developed in the Calculus; cf. for example, the Author’s Advanctd Calculus, 
Cap. XIX. 
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Moreover, df/dcL exists and is continuous for all points 0 S or < oo, 
— oo < a < OO: 

= (3a^ — 2it^x) 
o oc 

Nevertheless, differentiation under the sign of integration is ijiiix)ssible 
when a = 0. For 

d'V _ j 
da. 

but the integral 


when a. = 0. 



And still again, it is not true that 

tt|. oo oo *1 

S ^f{x,a.)dx =J* dx J*f{x,a.) da, 

«o e * “o 

even when^Cx. a) satisfies the above requirements and all the in¬ 
tegrals involved converge. For example, let 
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§8. Double Limits. The phenomena described in the last 
paragraph are all examples of double limits\ 


lim \ f{x,a.)dx 
a*.Xo«/ 

c 

and 

e 

00 

A y /(x,a) dx 


eo 

lim - 

and 

C lim dx\ 

J AfiP-O 

c 

It 

limVAtt* C f{x,a.'^-dx 

and 

oo 

^lim V fix, tti) dx. 

«/ 

e 

The questions are precisely similar to those that arose in infinite 


series: 

i) Continuily of the function defined by a convergent series 
of continuous functions; 

ii) Differentiation of a series term-by-term; 

iii) Integration of a series term-by-term. 

In the earlier case we found that uniform convergence was the 
key to the situation, for it enabled us each time to infer the equality 
of the two double limits. The same holds true here. We lay down 
a definition of uniform convergence for an integral analogous to the 
definition of uniform convergence for a series, and apply it in a 
similar manner. 

In a larger sense both definitions of imiform convergence come 
under the general case embodied in the theorem of Chap. V, § 10. 

§9. Uniform Convergence. Definition. Let f(z,a) be a 
function which, 'for each point a of an infinite point set is con¬ 
tinuous in X, 

c ^ X <. oo. 

The integral 

PO 

1) f fix,a.)dx 

0 

is said to converge uniformly in the point set A if, to a positive c 



DEFINITE INTEGRALS. LINE INI EGRALS 


275 


chosen at pleasure there, corresponds a number g c) independent 
of a and such that 

^ f ix^Oi) dx < €, g 

X/ 

Theorem I. A necessary and sufficient condition for the 
uniform convergence of the integral' 1) is that, to a positive € 
chosen at pleasure, there correspond a number ^ c, independent of 
a and such that 

X 

J f{x,a.)dx < €, g X. 

e 

Theorem TI. A necessary and sufficienf condition for the uni' 
form convergence of the integral 1) is that, to a positive € chosen 
at pleasure, there correspond a number g c) independent of a 
and such that 



§10. The de la Vall^e-Poussin p.(x)-Test. Weierstrass’s 
Af-Test for uniform convergence in the case of infinite series finds 
its exact counterpart in de la Vallf*e-Poussin’s ft (j:) -'J est in the case 
of definite integrals. 

De la. Va.llee-PolssIn’s ft (x)-TEsr. Let ft . (x) be a function 
continuous for c y x. If 



fix, (i)dx 

converges uniformly in the interval A ^ a Si B. 

• For the sufficient condition one must, of course, begin by requiring the 
plain convergence of the integral 1) 
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Proof. Let c > 0 be chosen arbitrarily. Then g" (S y) can 
be so determined that 

^ ^{x)dx <. g ^ x^ <, X*'. 


X" V X” 

J f{x,a.)dx \f{x,a.)\dx ^ f fi (x) dx. 


Hence 


X>f 

j 


dx -< €, g ^ x' <. x". 


But g is independent of a, and so the theorem is proved. 
Example. Tlie integral 


oo 


dx 


converges uniformly in any interval bounded, from above: 

a ^ G. 

For, let 


EXKIlCfSKS 


1. Show that the integral 


oo 


e * log xdx 


converges \iniforrnly in every interval bounded from above. 


2. The same for 


oo 

^ (log a:)P dx. 


3. What can you say regarding the uniform convergence of 
the integral 

OO 

C e"** cos a*xdx ? 
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4. The same for 


5. The same for 


r (tdx 

J 




.-x2(l+a2) 


§11. Continuity. Theorem. If f{x,a) is continuous in 
the region 


R: 


c ^ X <. oo, A ^ ou ^ B, 


and if the integral 

oo 

f <t.)dx 

C 

converges uniformly in the interval A ^ a ^ B, then the in¬ 
tegral defines a function, 

03 

V’ («•) = J f (•*- «-) dx, 

C 

continuous in that interval. 


Proof. We wish to show that, to an arbitrary A ^ clq ^ B 
and to a positive € chosen at pleasure, there corresponds a positive ^ 
such that 


I (o-o + A) — <f (o-o) 1 < «. 1 A 1 < J, A ^ a .0 + h ^ B. 

Now, 


(o-o + A) — f (ao) = f \f{x,a-o + k)— fix, tto) j dx + 


CO 


oo 


(x, ao) dx, 

s e 

no matter how c ^ ^ be chosen. Let c' be an arbitrary positive 
number. Then, by Theorem IT, § 9, a number g c and inde¬ 
pendent of tto, h can be found such that 


j /U, rt-o + h)dx 
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to SO 

l/^<‘ , a© + /t) I < €\ j ^ /(x, a©) | < 

Hold this g fast. Then, since 

^fix, aydx 


represents a continuous function of a in the interval ^ ^ a. ^ B by 
§ 1, it follows that 

\J |A| < #. 

C 

Hence 

1 f (ao + A) - ^(ao) 1 < 3 1 A | < 

and it remains only to choose c' so that 3 c' = c. 

Example. The integral 


1 

represents a continuous function for all values of a. For, let a© be 
an arbitrary value. Let G be chosen > a©. Then the integral 
converges uniformly in the interval a ^ G (cf. § 10) and so repre¬ 
sents a function continuous at a = a©. 


Exercises 

1. Let a point set ^ = fa } be given, witn a point of con¬ 
densation, a©. Let fix,ti) be a continuous function of x in the 
interval 

c ^ X <. oo 

for each a, c being a constant. 

i) Lety’Cr, a) converge uniformly in any finite interval, 

X ^ G, 

when Ob approaches a©; 


ii) Let 
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«X)nverge uniformly in A, Then 


lim f(x^ a) = CO (-r) 


is continuous, c = x < cxd ; 


oo 

^ 00 (x) dx converges ; 


oo oo 

c) lim I f (.r, a.) = / lim y (a:, tt) dx, 

aa«<Xo 

c c 

2. Lety(:r, a) be a function which, for each a of an infinite 
point set A, is continuous in x, 

c ^ X <, oo. 

I.et ao be a point ol condensation of A, For iui arbitraiy value x^ 
of X let /'(.r, a) approach a limit: 

lim f{x^a) exists, c S < oo. 

(X, a) = fxi, <Xq) 

Finally, let the integral 


oo 

J*f{x, tt) 


converge uniformly in A. I'hen 


lim f (x, a) = ci> (:r) 
ot=ao 


is continuous, c ^ x < oo; 


CO 

co(x)dx 


converges; 


oo oo 

Urn I /(j:, oc) cfx = I lirriy(x, a) C3?:r. 
a**ao ty nJ a=aao 


§12* Integration. Reversal of the Order. Thkohem. If 
the function f {x, cl) is continuous in. the region 

R ‘ c?rx<oo, A ^ a ^ B, 
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and if the integrtd 1), § 9, cxmverges uniformly in the interval 
A ^ a. ^ B -. 


then 


or: 


oo 

•i'(a-) = J* f (x, a.) dx, 

C 

®1 ro ®1 

J* <f>(,a.)da. = J* dx J*f{x,a.)da., 

a© c a© 

*1 OO OO «l 

S J*fix, a.) dx =J* dx // {x, a) da, 

0© C CO© 

Proof, The function ip {a) is continuous by §11. We wish to 
show that, to an arbitrary € > 0 there corresponds a number g 
c) such that 

*1 ar «1 


<p{a.)da.—J dx J*f{x,a.)da. 

I»0 CO, 


< €, g X. 


Now, 


Jf {x, a) dx = ffix,a)dx+J* f {x, a) dx^ 

OCX 

and for a fixed x each integral on the right is a continuous function 
of a. Hence 

®l OO ®1 jp «1 00 

Jd, J’fix,a-)dx =J* da.Jf[x,a.)dx+ x^a)dx, 

0© c cr© c a© i 

Ihe order of integration in the first integral on the right can 
be loversed, § 5. Thus 

«1 oo ap ®1 «l oo 

J da. J fix, a) dx -JdxJfix, a) da = ^ da J*fix,a)dx. 

C «o «o * 

Because of the uniform convergence of the given integral, 


I ffix, a.)dx^ < 


g = x. 
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Hence 


-I oo 

^J*da.J*f{x,o.)dx < lai—ttole', g ^ x, 

Oo X 

and it remains merely to choose c' so that 1 oti — (Xq I S €. 


Exercise 


Under the conditions of the theorem, show that the integral: 


oo a 

S j*fix, a.) da. 


converges uniformly in the interval A ^ a. B. 

§ 13. Leibniz’s Rule. Theorem. Let the integral 1), §9, 
converge in the interval A ^ a ^ B: 


oo 

fpia-) — J fix, a.) dx. 


Let df/dos exist and let the function 




be continuous in the region 


c ^ X <, oo, A ^ (t ^ B, 


Finally^ let the integral 


oo 

ffaix,a.). 


converge uniformly in the interval A ^ (t ^ B. 

Then the function if {<t) has a derivative., the derivative is 
continuousy and it is given by the last integral: 


^^jMx,a.)dx. 
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Proof. Let 


oo 

= J*ft{x,a.)dx. 


Then 


oo a 


Hence 


^ dx ^ ^ dx 

A C A 

oo 

c 

oo oo 

= J* f(,x,a.)dx —J* f{x,A)dx. 

c c 

a 

J* yjr (a) da. ^ ip (a) — tp [A), 


and the proof is now given by the theorem of Chap, IV, § 7. 
Example, The function defined by 

oo 

^y* e"“^ dx 

1 

can be differentiated with respect to a for all values of the argument. 

Exercises 

1. Knowing that 


show that 


Je-^dx = i^, 

0 

c»o ^- 

o<». 


Hence show that 
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2. Obtain a formula for 


oo 

J* j^e-^dx. 


It = ly 2, 5, • • •. 


§14. Applications. It is now possible to complete the proof 
of certain evaluations of definite integrals studied in the Calculus*. 

Example 1. Consider the integral 


1 ) 


QO 

“=/ 


e""*® cos (tx dx. 


The convergence for all values of au was shown in the Calculus. 
Moreover 

da 


* xe smttx 


is continuous in the re^on 

Kl O^Xy 

and the integral 


oo < a < oo, 


/ 


— xe”'*® sin ax dx 


converges uniformly for all values of a. Hence Leibniz’s Rule is 
justified. Integration by parts requires only elementary methods. 
Thus it is seen that 


du 

da* 


T 


The integral of this equation is the function (Chap. XII, § 7): 
u = ke ^* . 

When a == 0, 


OQ 

“ = / 


e^^dx : 


.1/^ 


Hence the integral 1) has the value: 


CO 

f 


f ^ wr 

cos ax dx 5 = e”* . 

A 


• Ct the Author’s Advanced Calculus, p. 487. 
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Example 2. The integral 


2 ) 




dx 


can be treated in a similar manner. First, 


du 

da* 


oo 

=-/■ 


a*x ^dx^ 


a ^ 0, 


For, this last integral converges uniformly in the interval 

0 < f g a, 


since 


and hence 


-.o 1 , -5 ^ 1 

ax ar 2 = — • < —, 

a a 


g -i- «-** = (ar). 

a 

On changing the variable of integration, setting y ^ a/x^ it is 


€ = *— 


found that 

Hence 


du ^ 

— — — 2i/. 

da 


u = Ce-2«, 


0 < a. 


Let a approach 0. The integral 2) is uniformly convergent for 
all values of a. Hence 

vT 


lim n = I 4 

aaeO’f ty 


r^dx = 


and so 


C = 


t/; 


If a < 0, the value of u is the same as for | a {. Hence finally 

a, unrestricted. 




The function is continuous at the origin (as elsewhere), but it 
has no derivative at the origin. It has a forward derivative, equal 
to — ; and a backward derivative, + -j/ r. The function is 

an even function, and so its graph is symmetric in the axis of 
ordinates. 
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Evaluate the integral: 


Exercise 




Compute its value for a = 1. 

§15. The Gamma Function. Let the Gamma Function be 
defined by the integral, 


r(a)=-- J 


This integral is shown by the ordinary tests to converge for all positive 
values of a: 0 < a; cf. Advanced Cakidus^ p. 480. We now 
proceed to show that F (a) is continuous for all such values of a. 
Let the integral be written as: 


The second integraJ, 


oo 1 oo 

S-M 

0 0 1 

oo 

\jr (a) = dXy 


has already been shown to converge uniformly in any interval bounded 
from above. If, then, a' be an arbitrary value of a, it can be in¬ 
cluded within such an interval, and hence \|r (a) is continuous at 
But oi' is any value of a. Hence the integral is continuous for 
all values of a. 

Turning now to the first integral, 


1 

^(a) = x*'^^e"~*dxy 


we see that this is an improper integral which can be transformed 
into the class considered in §§9-l3 by a change of variable, 

r-— a:-—• 


if (ct) == ^ e'“ \ dt. 
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This integral converges uniformly in any interval 0 < j ^ a < oo. 
Hence it represents a function continuous for all positive values of a. 

G)mbining the two results we see that F (a) is continuous for 
all positive values of a. 

Differentiation of the Gamma Function, The function ^|r(a>) 
has a derivative given by Leibniz's Rule: 

oo 

1 

The integral 4) can be differentiated under the sign of integra¬ 
tion for positive values of a. Hence, on transforming back, we see 
that the same is true of the integral 3). 

Thus it appears that the Gamma Function has a continuous 
derivative for all positive values of a, given by the formula: 

oo 

6) log X dx, 

0 

The existence of higher derivatives of all orders is proved in 
like manner: 

oo 

6) ^ x^'^^ e’"^ i^ogxf dx, 

0 

§16. Improper Integrals over a Finite Interval. Instead 
of transforming the integral 5) into the form 4) considered in 
§§9-13 it is possible to give an independent treatment, parallel to 
that of the earlier case. 

Let y (a?, a) be continuous in the region 

A: a ^ x A ^ a* S B, 

though not in general bounded. The integral 

//(». a) dx 

a 

is said to converge uniformly in the interval A ^ u S B if, to 
an arbitrary c > 0 there corresponds a positive f, independent of a, 
such that 
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x» 

\J* /(a:,a)dx| < e. 

Xf 


< a/, < a + <y. 


The two theorems corresponding to Theorems 1, II, § 9 are now 
formulated as before. The /t (x)-test is developed, and the theorems 
of continuity (§ 11), reversal of the order of integration (§ 12), and 
Leibnizes Rule follow as before. It is a useful exercise for the student 
to write these theorems out in detail and to give a complete and^^ 
independent proof of each. 

Similar remarks apply to the integral 
h 

J */(^. «•) 


where f {x, a) is continuous in the region 
R: a^x< b, a ^ B. 


If f (x, a) is continuous in the region 
R: a < X < by A S ou ^ By 


the integral may be broken up into the sum : 



a <. c <, by 


and each of the latter integrals treated as above. 

Remark, It would be a mistake to think that the above defini¬ 
tions exclude the case of proper integrals. The improper integrals 
are analogous to infinite series, the proper integrals to sums, so that 
a proper integral, under the above definitiohs, is like an infinite 
series whose terms, from a definite point on, are all 0. Because of 
this analogy the improper integrds are sometimes called '^infinite 
integrals”, but the irrelevant connotations of such a terminology are 
too disturbing. 

Exercisls 


1. Show that 



g 0 

and hence 


x^^^ dx 


\ * 

dx ^ x^^^ dyy 

0 g 


0<g<h, 
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1 

/ 


- dx = log —. 

g 


2. Prove the last equation to be true by means of partial 
differentiation and Leibniz’s Rule. 

3. Let f (x, a) be continuous in the interval 

a <, X <. A 

for each a of a point set and let ao be a point of condensation 
of A. Let 

lim /(j:,a) = a>(jr) 

(jr/, «q) 

and let 

A 

fix, a) dx 
a 

converge uniformly in A. Then 

A A 

lim I / (a:, a)rfar= I lim / (x, a) 

^ a a ^ 

§!?• The Beta-Function* The Beta-Function is defined by 
the integral 

1 

t) jB(m,/i)= ^ 

0 

It converges for 0 < m, 0 < n, and is a proper integral when 
Ism, 1 s n. Break the integral up into the sum: 

1 




0 < c < 1. 


The first integral, 

C 

2) ip (m, n) =r .^(1 xY^^ dx, 

0 

converges uniformly in every region 0 < f g m, 0 < /i. 
For, if ^ 

IL (x) « (1 - 


then 
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0 g g ^(x), 

and the /t (x)-Test applies. 

Similarly, the second integral, 

1 

3) /i) = ^— x)^~‘^dxi 

c 

converges uniformly in every region 0 < m, 0 < f g / 7 . Hence 
the Beta Function is continuous throughout the region 0 < m, 
0 < n. 

By a change of variable, 





x = -2i-, 
1 + y 


the Beta Function can also be written in the fonn: 


4) 




It is connected with the Ganuna Function by the relation, § 19; 


Exercisk 


Show that the Beta Function admits derivatives of all orders. 

§18. Both Limits Infinite. There remains the case of the 
reversal of the order integration in the integral 


1 ) 


a h 


{x, y ) dy. 


Let f{x,y) be continuous in the region 
R'. a ^ X, b ^ y. 

We can obtain a test by means of the Theorem of Chap. V, § 10. Let 


s(x,y) 



f{x,y)dy. 
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Theorem. Let 


oo 


converge vniformly in any finite interval^ a ^ x S A; 




converge unifonnLy in any finite interval h ^ y ^ B; 

oo y 

iii) 

a b 

converge uniformly in the infinite interval, b ^ y < co. 
Then each of the integrals 

oo oo oo 09 

/ dyj f(x,y)dx, f dx J* f{x,y)dy 

a a 0 

converges, and the two are equal: 

oo oo oo oo 

A// {x,y)dx = H f{x,y)dy. 
Proof, From i) it follows that 


^ms{x,y)=i J* dyff{x,y)dx— f dx ^ fi.x,y)dy = tf{x) 


From ii) it follows that 


« y r oo 

I dx I /(x,y)dy= I dy I /(x,y) dx = \lr(y) 

»aoo %J U %/ %J 

a b ha 


From iii) it follows, since 






that 
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1 s{,3?\y) — sfx'.y) I < e, 




where g is independent of y. Hence all the hypotheses of the 
Theore.ii cited are fulfilled and consequently: 


a) 


lim <p (xj exists, or 


b) 


oe CO 

dx j*f{x^y)dy‘ converges; 
lim (y) exists, or 

M oo 

f y) dy converges; 


OO 00 CO CO 

s dx s f{x,y)djr= J ^f{x,y)dx. 

ah b a 

Thus the theorem is proved. 

Corollary*. in particular ^ 

0 ^ /(x. y\ 

and if 


S y* fi^x,y)dy 


converges^ Condition iii) is automatically fulfilled. 

For, let 

OO 

V- (a;) - f f{x,y)dy 
h 

Then fu (x) is continuous and ^ 0. Moreover, 

OO OO OO 

l^(x)dx= j dx C f{x,y)dy 

a ah 

converges. Hence the de la Vallee-Poussin p. (x)-lest applies to the 
integral 

* This corollary, which is of chief importance in practice, is due to 
Professor G. A. Shook. 
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since 


F (x, y)dx, F {x, y)=J^f (x, y) dy. 


y)dy ^ I f{x, y)dy = ft. (x). 


y 

0 S ^f{x,y)dy ^ J* 


§ 19. Application. The B-Function in Terms of the V-Func- 
tion. The 5-function can be expressed in terms of the F-function 
by the formula : 


1 ) 


B (my n) 


T(m)T(n) 
r (m + n) 


The formal part of the proof is easily given. If in the F-integral, 
§ 15, we change the variable of integration from x to yx we have : 


Thus 

and 
2 ) 


r (m) = j* y" x™-! e-y* dx. 

oo 

r (m) y-' e-y = J ym+n-1 ^-r{i+») 

0 

oe oo oo 

r (m )^ dy = y* ix^ djy 


provided it is pennissible to reverse the order of integration in the 
iterated integral. The value of the integral on the left is F (n). The 
first integral to be computed on the right is substantially the F-integral. 
For if in § 15, 1), we change the variable of integration from x to 
(1 + fiod: 


Thus 





F (m+n) 


r(m)r(n) = r(m + n) 



dx 
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But this last integral, by § 17, 4), is equal to 5 (m, n). 

It remains to justify the reversal of order in the iterated integral 
2). G)nsider first the iterated integral: 


oo oe 

5) j dx ^ fly 

\ 1 

In accordance with Condition i) of the theorem of § 18 the integral 


oo 

j yrn+n-^l 


converges uniformly in any finite interval 1 ^ j: = G. For, 


^m—1 1 .v(l+jr) ^ 1 J' 

and the ^-test applies. 

Secondly, the integral 


oo 







converges uniformly in any finite interval 1 = = G. For 

^m+/i-l g-yii+x) ^ ^m-1 ^ 

and the ft-test applies. 

Since the integrand is always positive and one iterated integral 
converges. Condition iii) is automatically fulfilled; i. e. we have the 
case considered in the Corollary. 

Thus the right to reverse the order of integration in the iterated 
integral 3) is established. Turning now to the integral 2), which is 
the one we are interested in : 


4) 


» or* 

y* dx y * .r"*-! dy. 


we see that we can break it up into the sum of four integrals; 


r^oo 11 oo] loo oooo 



The last integral is the one we have just discussed, 3). Each of the 
others, by a suitable change of variable of integration, can be brought 
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under the cate considered in the Theorem of § 18. Thus in the 
first intend on the right we may replace x by \/x and y by \/y. 
We find: 

oe ee 

/* dx^ (f-xd+i) dy. 




Here, the exponential factor does not help in the convergence — 
naturally. But since we are integrating from t to co, tliere is no 
difficulty in obtaining each time a suitable ^-function. The further 
details are left to the reader. 

The example suggests the formulation of a general theorem, to 
which we now turn. 


§20. Rectangular Region of Integration. Consider the 
integral: 


J { f{.x,y)dy. 


where f{x,y) is continuous in the open rectangle 
Ri a < X < A, b < y < B, 

but is not necessarily bounded. We can paraphrase the theorem of 
S 18 as follows. 

Theorrm. Let 


/ 


f(x,y)dy 


converge imifornily in any interval 

a' ai X = a <. <■ A^ <, A ^ 

A 


ii) 


J 


dx 


converge uniformly in any interval 

^ y ^ Bf, -b < V < B < B, 


Ui) 


A ^ 


a »l 

converge uniformly in the region b < y <. By 


b < fi < B. 
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Then each of the integrals 


Jf ^ Jt JS 

S J' ff^^^y)<iy 

^ a ah 


tmvergeSy and the two are equal: 

BA A B 

j'dy Jfi.x,y)dT= j dx j*f(,x,y)dy. 

ha a b 

The proof can be given by paraphrasing the proof of § 18, using 
the theorem of the Exercise, Chap. V, § 10, 

or r 

= J dy^ f(,x,y)dx 

where liin (£, x) = (/r. A), lim (ij, y) = (^, B)* 

A less elegant, but more elementary, proof consists in breaking 
the given integral up into four integrals: 


A B A B a B A {i a0 


a <. a <, A 
b< p < B 


and then transforming each into the integral considered in § 18. 
Thus the first integral on the right will be subjected, for exaunple, 
to the change of variable: 


r' = 


a: — a 


y = 7 T P 

^ B-y 


A-x ' 

And similarly in the case of each of the other integrals. 
CoaoLLARY, If, in particular, f [x, y) ^ 0, and if 


A JS 

/■'V’ 


f{x, y) dy 


converges. Condition iii) of the hypothesis is automaticaUy satisfied. 
Finally, one or both of the limits of integration A, B may be 
replaced by -f oo, and' independently either or both of the limits 
^ by — cx>. 


* The proof wos given in this way by one of iny students at Harvard, 
whose name I cannot now recalL 
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§21. Appraisal of an Alternating^ IntegfraL Consider the 
integral 


J* gj^si 


sin X dx. 


where ip{x) is continuous, c ^ x^ and 




c S y < x". 


lim gs {x) = 0. 


Write: 


* **1 

/=/-/ 

e e Xi 




where xj^ = kr and 


Xi — r g C < Xj, . Xn £ X < X„ -h T. 

Ajsume first that c ^ jrj — r •— xq. We then have an alternating 
series who«e terms are in general decreasing numerically (never in¬ 
creasing) and the general term approaches 0 as a; becomes infinite. 
Hence the integral converges. Moreover, the error made by breaking 
off with an arbitrary x c does not exceed 


•1 

I y* ^{x)8inxdx < 2(p[c), 


2) 1^ ^{x)s^xdx < 2^(c), c S a: < oo. 

c 

The same appraisal holds when — ir < c < Xi» For, extend 
the definition of <p (x) to the interval {xq, c), setting 

ip(x) sz (p {c\ Xi^^ T ^ X < c. 

Then, for the extended function, 

x 

^ ip(x)8\nx dx 


lies between 
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* 

J* ^p(x)sit 


X 

I* ^!>(.r)si 


sinxrfj:, 


j sin X dx and 

Xo Xi 

and each of these integrals is appraised by 2), 

With the same conditions for ^ (x) the same appraisal is obtained 
for the integral 


J' ip {x) sin (x + y) dx. 


In particular, 

3) 

Finally, m > 0 : 

4) 


X 

x) cosx 


dx 


3) 


j y* y>(x)si 

C 

i/vw 


sin mx dx 


cos mx dx 


< 2(p(c), 


2 (c) 


2ip{c) 


Exkrctsb 

Let if {x, a) be defined in the region 
ft : c ^ :r < oo, 0 < a S 

Let ip {x, ao) be a continuous function of x for an arbitrary choice 
of ao > 0. Let 

i) <p (a:', tto) S <P W, ao), c S a:' < a:"; 

ii) lini ip (or, ao) = 0; 

rsaeo* 

iii) lim ip (c, a) = 0. 

0^=0 

Then 

oo 

05 (a) = j ip (x, a) cos X 


approaches 0, as a approaches 0. 
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M 

§22. Computation of j* 


That this important integral converges, is shown in the Calculus. 
Let its value be denoted by K. Since 

1 . . n I . sin(n+i)i: 

i+cosa: + cos2^ + •** +cosnx = —, 

2 sin V 

we see that 

/ sin (n-f 1^)3: r 

2 sin i 3: ^ 2 ’ 

0 

Moreover, on changing the variable of integration from 3 : to (n + J) 3 :, 
we have: 


oe 00 

/* sin X ^ _ P sin (n- 


— ^ = r (— — -nr-r^-T-*) sin (n-\-\)xdx+ f dx. 

2 ^ \x 2 smfx/ J X 

Now, change the variable in the last integral, setting 

t = (b + I) a;, A = (n + J) T. 

Thus this integral becomes: 

h 

and so approaches 0 as n = 00 . 

The first integral approaches 0 by Chap. VIII, § 1, Exercise l 
Hence K = r/2: 


00 

^ sin 3? 


dx = ^. 


§23. Applications. The integral 




nr?' 
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can be evaluated by setting 


1 




,-r*(i+x2) 


dy 


and reversing the order of integration in the iterated integral 

oo oo 

2) m = 2 ^ ^ y cxx&mx dy. 

For, by Example 1, § 14, 

2 ^y cos mx dx = -v/ir” 

and hence, by Example 2, § 14, 

oo 

3) li = ^ ery^'i^ dx = 

0 

It remains to justify the reversal of order in the iterated integral. 
This is done by the theorem of § 18. 


ad i) 


/ 


y cos mx dy 


converges uniformly, 0 S .r, for 

1 y cos mx | S y = /i* {y)» 


ad ii) 


/ 


y cos mx djf. 


0 

This is not so easy, for the uniform convergence cannot be establisheit 
by means of the ^<test. 

For simplicity of presentation set m = 1 and consider the integral 


4) 


/ 


y cosxdx. 


0 

This is an alternating integral, and the value of the remainder can 
thus be appraised. The integral has the value: 
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where 


X,=kT--. 


Since the function 

0 < 

is monotonic decreasing as x increases and has the limit 0, the value 
of the partial remainder 


^ Gosx dx^ 




is less numerically than the contribution of the arch in which £ 
appears: 

a ^ i < h, a kT — ^ = Ar 4* i* 


or; a xk, b = Now, 

h h 


I ^ COS X dx j dx = a <i X <. h. 


a 

Hence 


5) 


1 / 


e cos xdx 




For a fixed value of k (however large) and a small value of 
^ > 0 this appraisal will not be small; but it will always be less 
than IT. 

Let us formulate now what we wish to establish. To prove that 
the integral 4) converges uniformly in any finite interval 0 ^ jy ^ B 
is to show that to an arbitrary € > 0 corresponds a g independent 
of y such that 


6) I ye^^^^’^^^cosxdx^ < €, g S x. 

We can do this as follows. First 


X 





cosxdx 
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is bounded for all values of 0 ^ x < oo: 


X 

1 / 


QQ^xdx 


7) 

Q>nsequently 

I y cos xdx 


< M, 


< yMy 


5 


no matter how xbe chosen. Let S be determined by the relation: 

8 ) 


Then the condition 6) is satisfied when 0 ^ jy ^ 8^ no matter how 
J, a: be chosen. 

Next, restrict y to the interval 
9) 8 < y m B, 

And now the appraisal 5) shows us that, if g be so chosen that 

ir B < €, 


the condition 6) will be fulfilled. This completes the proof of uni¬ 
form convergence under ii) when m ^ 0. 

Turning now to iii) we have to show that 

oo 

J‘ F{x,y)dx 

« 

converges uniformly in the interval 0 ^ jy < -j- oo, where 

y 

F{x,y) = / y cos mx dy. 

It is easy to find here a function f* {x)^ namely: 

oo 

(*••(*) = dy = . 

0 

This completes tlie proof when m ^ 0. When m = 0, the 
evaluation 3} is seen at once to hold by inspection of the integral 1). 
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Exercises 


1. Show that 


09 

/ 


X Sin mx 
1 + 

2. Show that 


f e-'”, 0 < m 

dx = 0, m = 0 

m < 0 



o» 

/ 


sin m j: 


I, 0 < m; 

dx = ^ 0, m = 0 

- m < 0 


suggestion: Set m = 1, 


CO 


and apply the theorem of §20. 

This is, of course, an exercise in method. The result can be 
obtained at once from §22. 

3. Show that 

no oo 

/ ysinky . _ p kcosbx . ... 

0 0 

by establishing the right to reverse the order in the iterated integral 




cos hx sin ky dy. 


4. Show that 


/ X sin hx , . 


I 
0 . 
- f 


^<b 
b = 0 
b<0 


§24. Duhamers Theorem. In formulating oertain physical 
quantities as limits of sums it frequently happ^ that the sum in 
question is nearly of the form of a sum whose limit is a definite 
integral, and it seems highly probable from physical considerations 
that the two variables have the same limit; namely* the definite 
integral. Duhamel devised a theorem which meets the requirement. 
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1*HEOREM 1. Let 

0*1 + cx*2 0 ^ a;fc , 

he a sum of infinitesimals which approaches a limit as = oo. Let 

Pi + ^2 + * • • + 
he a second sum such that 

lim — =1 
tf'k 

in the sense of a uniform approach; i,e. shall approach the 

limit 1 uniformly as tz = oo. Then the second sum approaches a 
limits and the two limits are equal: 

lim (a^ + a 2 + • * • -I- a„) = lim 0i + P 2 + ‘ ‘ + P«)- 

n=oo n=:oo 

Proof, Let 

- = 1 + c*. 

Uk 

Then, by hypothesis, to a positive € chosen at pleasure there corre¬ 
sponds a fixed m such that 


C*l < €, 


m S n. 


Hence 


Pi + P 2 + ’ ' * + P* = 0*1 "h 0*2 4- • • • 4- 0*71 
4* 0*1 Cl 4* 0*2 C 2 4 - • • * 4" O-n Cn* 


Since > 0, we have: 

1 0.j Cl 4" 0»2 C 2 4“ * ’ ' 4“ O-n Cn 1 (o*i 4“ 0*2 4“ * * ' 4“ 0.n) €. 

The sum 2 is bounded, and so this last expression can be made 
as small as we please. This completes the proof. 

Another form of the theorem is the following. Consider a 
proper-definite integral: 

n k 

lim V /(xl) Ax* = / y (*) dx, 
i»=«>*3i V 

the integrand being continuous in the closed interval a ^ x ^ h. 
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Let tpk be deHned for each partition of. the interval and for each 
value of A; and let 

f* =f(^k) + C*, 

where Ca approaches 0 uniformly ; i. e. to a positive € chosen at 
pleasure there shall correspond a fixed S such that 

1 C* 1 < €, 1 1 < ^, 

no matter how the interval (a^b) may be partioned. Then the 
sum : 

if I AXi + <p.2 + • • • + f n 

approaches a limit, and this limit is equal to the definite integral r 



From a theoretical standpoint this latter theorem is more general. 
But in practice the earlier one is adequate, and more convenient to 
apply. Cf. the Author’s Introduction to the Cdkulm^ pp. 501-307. 
We may formulate the result as follows. 


Theoricm 2. het ^ be a closed regular region of the n~dimen¬ 
sional space of the variables (xiy • • *, Xn), and let /(ri, * • x„) be 

continuous in 81. Consider the integral: 


S ■ ■ S 


81 


Let ipff be defined for each element of volume^ and let 

9k ^fk -b Ca» 

where approaches 0 uniformly. Then 


n 




approaches a limity and 


lim 5^^P*Ar* = /*••• Cfdr 


81 


In attaching the name of Duhamel to these theorems one recalls 
the man who first dealt constructively with the question stated at the 
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beginning of the paragraph. Duhamel himself formulated Theorem 
U without however recognizing the importance of the uniform re¬ 
striction— this question had not been raised in his time. On the 
other hand, Theorem 2 is only one of a group of theorems designed 
by followers of Duhamel to accomplish the same object. It might 
be better to refer to this whole group of theorems as DuhameVs 
Principle, 


§25« Line Integrals. Let C be a regular curve in the 


(x, jy)-plane, and let f be 
a function, defined in the 
points of C and continuous. 
Thus y is a continuous 
function of the length of 
the arc of C, measured 



from an extremity. Divide 


C up in any manner into n arcs as indicated, and form the sum: 


n 




where and is the value of f at an arbitrary point 

Sk of the A-th arc. Then the line integral of the function f along 
C is defined and denoted as follows: 



the longest arc Aj* approaching 0. It is nothing 
substance, than the ordinary definite integral: 



more or less, in 


But in form the definition is important; for, first, we are 
thinking of a function as defined along a curve, and not in an 
interval of the scale of numbers. And secondly there is no question 
of the sense of integration along C. We could equally well have 
measured s from the other end of the curve, or from a third point, 
in either direction. It is essential that be taken absolutely, not 
as a signed quantity. It is important to point out these facts at 
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this stage, since the value of the line integral 6) below depends 
essentially on the sense in which it is extended along the curve. 

Theorem. Let ip^ he defined in any manner^ corresponding 
to the k-^th element of arc^ Ai*, and let 


«■» +1*. 


where C* approaches 0 uniformly as n = oo. Then the sum 

n 


approaches a limit as n = oo, the maximum Asj^ approaching 0, and 


5) 


lim y f * A^jk = 



The proof follows at once from DuhameVs Theorem, § 24. 

An important application in practice is the following. Let ipj^ 
be defined as above, and let Ij^ denote the length of the chord. Then 
the sum 

n 


approaches a limit as n — oo and 

4) 


lim '^iPkh= ff^^- 


For, let an arc of C be represented by the equations: 

^ = 'kW. y = <o {«); 

(s)® + = 1. 


Then 


= Ax*® + A^-*® = 


[ '(''(** + (-f* + ] As*®. 

Here, 

5) (s* + dAs*) = \|/ (s*) + q*, (s* + 0'As*) = «'(s*) + qj. 
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where fjjt, fjjt are uniformly small: 

I < € and I I < € if Ar* < J ; 
independent of Sj^. It follows, then, that 

= [ 1 + 2 \|f' (5*) f|* + 2 cd' (5*) iji + fjj^ + f|i^]A 5 jf. 
The functions V(r), (s) are bounded. 


I>(.'(r)! < M, U'Wl < M. 


And, of course. 


4 ^ Ar*. 


(1 - 2M€) As/ < 1/ S As/. 
From this result it appears that 


4 == (1 + Cjfc) As*, 1 Cjfe 1 < 

provided As* < S. We infer, then, that 


t/ I — 2Af € 


f*4 = [/(^a)^+ 4* ] (1 + C*) As* 

= [/ (^a) + Cjk ] As*, 

where (!/ can be made uniformly small by a suitable choice of S, 
and hence the convergence comes under the case treated in the 
Theorem. 

§26. Continuation. The Intes^ral: C P dx + Q dy. 

c 

Let P and Q be defined and continuous along the curve C, and let 
C be divided into n arcs by the points (x*, y/). A' = 0, 1, • • •, n. Let 

Ax* = X* - x*_i, Ajr^ -7k- 7k~u 

and form the sum: 


X Ax* + Q (x*, yt) Ay^. 

k^l 
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Let n = oo, the longest As* approaching the limit 0. Then the 
sum approaches a limit, and this limit is defined as the line integral 
of Pdx + Qdy, taken along C: 


6 ) 


lim y [P {xj,, yk) Aar* + Q (x*, yj,) Ay*] = C Pdx^Q dy 



^XQ^yo) (x,. X\) 


The proof of convergence is as follows. Measure the arc of C 
from the point {xQ^y^). Then 

P (^*. r*) + Q (**. yk) = 

{ 

The brace differs uniformly little from 

P (J^*. yk) cos r* + Q (a:*, y^) sin r*. 

because of 5), ard hence the convergence is ensured by the results 
of § 25. We see, moreover, that 

z 

7) f Pdx + Q dy = I (P cos r + Q sin r) ds^ 

V 

where s is measured from (xo,yo) ^ is the angle from the 
positive axis of x to the tangent in the sense of the increasing 

Unlike the line integral 1) the present line integral depends on 
the sense in which the curve C is described; for, the point (xq, y^ 
may be taken at either extremity. Another notation for this integral is: 
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where = (^o»^o) ^ire the coordinates of the initial point, and 
B) are the coordinates of the terminal point. We see, then, that 

{a.h) (A.B) 

9) j^Pdx + Qdy=--JpdX’^Q dy, 

i^B) (ifb) 


The extension of the definition of each line integral, 1) and 6), 
to the case of n dimensions is immediate: 


y* Pdx Q dy + K dz. 


and 


.r 


Py dXy + • • • + P/I dXn* 


Greenes Theorem,^ Let P = P{x,y) be continuous in a region 
5 and let dP/dy exist and be continuous in the interior of S, and 
bounded. Then 




Pdx, 


the line integral being extended in the positive sense over the com¬ 
plete boundary C of S; cf. Advanced Calculus^ p. 222. Similarly, 



• The Germans call it “Gauss’s Theorem” — and with equal justification. 
For Gauss, like Green, perceived its fundamental importance in analysis. But 
the one name cannot be preferred to the other on the basis of priority, since 
the representation (in three dimensions) of volume integrals by surfa^ integrals 
goes back to Lagrange (1760/61): Oeuvrtt vol. 1, p. 263. 
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Fro-n these two equations it follows that 

f/(w 

The proof of these theorems given in the Calculus is complete, 
provided the boundary is cut by a parallel to an axis of coordinates 
in a bounded nuiuber of points and line segments. It is possible to 
remove this restriction from the identity 10), which is the only one 
that concerns us here, without going into an ititricate discussion of a 
limiting process, provided all the first partial derivatives of P and Q 
exist and are continuous within S, and are bounded. For, the identity 
10 ) is invariant of a rotatioji of the axes, or even, more generally, of 
an affine transformation. Let 


11) 


) » , 

^ J = ^2-^ + hy + C2 

and let P', Q' be determined by the transformation: 

f F = ai P' ■+ 02 O' 

1 Q = I-i P' + *2 O' 

P'dx' + (^d/ = Pdx + Qdy 

and 


12 ) 

Then 


Moreover, 


/ = 


djx'. y') _ 

^(*.r) «2 h 


¥= 0 . 


• • f ' I —£ ^ I 

If / > 0, then 


dy dx 


On the other hand. 
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14) J 4- Q'^y = J Pdx + Qd:y, 

Cf c 

each line integral being extended in the positive sense around the 
complete boundary of its respective region. Thus the invariance of 
the identity 10) is established in this case. 

If, however, / < 0, Equation 13) is replaced by the equation: 


S 


On the other hand. Equation 14) is replaced by the equation: 

16 ) J p>d3> + (^dy = - 

since the positive sense of integration over the boundary of S' is the 
opposite of that in which the image of C is described. Thus the 
theorem is true in this case, too. 

Partition of S into Regions of Normal Type, It is possible 
to divide a region iS into a finite number of regions of normal type. 
These consist i) of squares with their sides parallel to the coordinate 
axes and not exceeding in length a given fixed quantity, hy and 
moreover, lying inside of 5; ii) of regions defined by the following 
figures: 


j Pdx Q dyy 
c 


Type I 


Type n 







The bounding curve in Type I can be expressed in the torm: 

X =/(*); 

and the two curves in Type II are grven by the equations: 

y =/U). y = v W- 

f{,x) < /(x), a < X ^ b. 
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where y(x), f(x) are continuous, together with their first deriva 
lives, in an interval 

a S X ^ b, b -- a < h. 

Each of these figures can be rotated through any multiple of 90^* 

It may happen that the boundary C of 5 is cut by a parallel to 
an axis of coordinates in an infinite number of points and line seg- 
ments. But on rotating a given region of normal type through a 
convenient angle, the new figure will have a boundary which is cut 
by such parallels at most in a bounded number of points. 

For the transformed figure the proof of the identity 10) is that 
given in the calculus. By the theorem of invariance just established 
the identity holds for the original figure. And now the identity 10) 
for the entire region 5, with its boundary C, is obtained by writing 
it down for each region of normal type, and summing. 

dP dO 

The Condition : ^ . Let <S be a closed regular region. 

Let P and Q be continuous in S, and let their first partial deriva¬ 
tives exist and be continuous at all interior points of and bounded 
in S, 

Let 2 be any regular closed region contained in S» G>nsider 
the integral: 

17) / P + Q dy, 

extended in the positive sense over the complete boundary F of 2. 
From the identity 10) it follows that, if 


18 ) 


dP _ dQ 
dy dx 


at every interior point of 5, then 


19 ) fp.. + Qdy = 0 . 

Conversely, if Equation 19) holds for an arbitrary 2 then 18) is 
true throughout the interior of 5. 


* A detailed proof of this theorem of partition is given in the Auttior’s 
Funktiorunduorie^ vol. I, Chap. V| § 9. 
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These results serve as the basis of the discussion of the function 
F{x^y) defined by the line integral: 


20 ) 


ix y) 

P{.x,y) = r Pdx + Qdy, 
(-•>) 


P and Q satisfying the condition 18); cf. the Advanced Calculus^ 
pp» 222*253, and the FunktionerUheorie^ vol. I, Chap. IV. 



Chapter X 

The Gamma Function 


§1. Definition. The Gamma Function has been defined in 
Chap. IX, § 15 by means of the integral: 

CO 

1) r(a:)= J' t*-^e-‘dt. 

The integral converges absolutely for ajl positive values of x and 
uniformly in every interval 0 <. S ^ x ^ Cr, where G is arbitrarily 
large and S is arbitrarily small. Thus T {x) is continuous for all 
positive values of x. 

The function possesses a derivative, given by Leibniz’s Rule; 

oo 

2) ^ = J* log t dt. 

0 

Moreover, 

oe 

*0 

and so we see that 


4) 


0 < 


di? 


for all positive values of x. Hence the graph of the function: 

5) y = r (x). 


is concave upward for all positive values of x. Furthermore, 
6) r (0+) = + 00, r (+ 00) =: + 00. 


Ihe first relation follows from the fact that, for small values 
of x. 


rw > J*t*-^e-^dt = -^. 


ex 



THE GAMMA FUNCFION 


313 


The second relation is a result of the fact (cf. § 2) that 

7) r(n+ l)=n!, 

combined with the fact just established, that the curve is concave 
upward. 

Finally, we note that, from the definition 1): 

8) r(:i:)>0, 0<x. 

Also 

9) r(i) = i, r( 2 ) = i. 

The first of these last relations is proved by direct evaluation of the 
integral 1). The second follows from 7) by putting n = 



The figure shows the graph of the function 

7 = r(a?+ 1 ), 

the dotted curve representing the function d log F (a: -f l)/dx ; cf. 
Duval, Armais of Math, 2d. ser. (1903/04) vol. 5. 

The graph of 5) is thus seen to have one and only one minimum, 
and this occurs for a value of x between 1 and 2. The value of x 
his been found to be: a? = 1.46163 • • • 











314 FUNCTIONS OF REAL VARIABLES 


§ 2. The Difference Equation. The Gamma B'unction obeys 
the law: 

1) T{x+ \)^xT{x), 


This is known as the difference equation. It is proved at once by 
integration-by parts: 


/ 


dt 





t* dt^ 


0 < X. 


A first application of the difference equation consists in setting 
X equal successively to the natural numbers : = 1, 2, 3, • • • and 

observing that r(l) = 1, cf. § 1, 9). 

A second application enables us to define F (:r) for negative values 
of X, Write 


2 ) 


rU) = 


r(x-h 1) 

X 


The right-hand side of this equation has a meaning when — 1 < ar < 0. 
This shall be the definition of F (x) for — 1 < :r < 0. It thus 
appears that 

F (x) < 0, — 1 < a: < 0, 

and continuous, the graph having the lines or = 0 and .r = — 1 as 
asymptotes. 

Repeating the process, setting — 2 < a: < — 1 in 2), we define 
F(a:) in the latter interval. The graph of the function is shown in 
the figure. In any panel, — (^4*1) < x < — A, the curve is 
always concave downward when k is even, and concave upward when 
k is odd. The pix>of is given conveniently by means of a later 
result; cf. § 3. 

§3. Gauss’s Product. Gauss* based his treatment of the 
Gamma Function on the following product, which he denoted by 
n(n, a:). We shall show in §4 that the limiting function is the 
function F (ar) defined in § 1. For the present we shall write with 
Gauss: 


1) 


IT (n, a?) 


_ 1*2.(n — 1) _ 

X (a: -h 1) (a: + 2) • • • (a: •+• n — 1) ^ 


• Werke^ vol. Ill, p. 144 . The date it January 50 , 1813 . 
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where x has any real* value ^ 0, — 1, — 2, • • •, and prove that, 
as 72 becomes infinite, TT(/ 2 , :r) approaches a limit. This limit we 
>vill denote by T {x ): 

2) r (j:) = lim Tl (n, x), 

n=33e 

The Convergence Proof. The variable 11 (n. a:) can be written 
in the form; 




11 (n, jc) = TI (2, x) 


H (3, a:) TI (4, x) 
11 (2, x) 11 (3, x) 


n (n, x) 
n(ft- l.x) 


1 2* 2-5* . 5 4* _ (n - l)n* 

X X + 1i (a:+ 2)2* (ar + 3) 3* (a: + n — 1) (n — 1)*' 


If, then, we set 

4) 


/nW = 


W (« + 1)* _ (1 + ^)* 

(x + n)n* 1 + s 


we have 


5) 


lim n (n, x) 

n=s<» 


X 


and the question of the convergence of IT (n, x) becomes the question 
of the convergence of this infinite product. But we have methods 
for dealing with this latter question; cf. Chap. I, § 10. 

Consider the series of logarithms: 

n=m 

Here, 

f„(x) = xhg — log (l + 

The convergence of this series is established at once by comparing 
its terms with the corresponding terms of the known convergent series: 




* The convergence proof applies at once to the complex domain, x being 
replaced by*»x + ^V — 1. 
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and applying the theorem of Chap. 1, §2; 

7Z»oo / y|2 2 

The value of the li nit is not important — only the fact that a limit 


Thus the convergence of x) is established and a function 
r (x) is defined by 2), or: 

1 - 

6 ) ^ 

n 

Properties of F (x). Since 

n(/i.l)= 1 

for all values of n it follows that 


r(i)=: 1. 


Next, observe that 


U{n,x^ l)=:^Z!^n(n,x). 

X -T 

Allowing n to become infinite we have the Difference Equation i 

8) r(a:+ l) = a:r(T). 

Notice that this result holds for ciU values ol x ^ 0, — 1, — 2,* • 

In particular, 

9) r(n+ l) = 7 il, n = 1,2,3, •••. 

A further relation satisfied by the F-function is obtained from 
the product: 

n (n, x) n (n, - x) =-{i^A)l 1®- 


j:- (1 — 0 ^) (2® —• • • • ([n — ip — a?-) 


Allow n to increase. The denominator corresponds to the infinite 
product for the sine-function, Chap. VI, § 6. Thus 

10> r(x)r(-a:)=- 1 -. 
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Another form of this relation is: 


11 ) 


rwrd = 

sm vx 


Fti particular, from this last relation follows that 

12 ) v{\)=^VV. 

Differentiation. I’he F-function is given by the series: 

13) log r (^) = — logx + 

^ {j:log(l + —) — log(a: + n) + logn}, 

when X > 0. The term-by-term derivative series represents in all 
cases the logarithmic derivative: 


14) 


n=l 


This latter series converges uniformly in any interval 

-G ^ X ^ G, 

from which the points a: = 0, — 1, — 2, • • • have been removed. 
For 

log(l+—)- - —={log(l+ j + 

V n J X -k" n t n n ^ n{n x) 

If, then, we choose the Mn of Weierstrass’s M-test as follows: 




-f 


n{n - G) ’ 


G< n. 


we see that this series converges by comparing Mn with l/n^. 

It is now easy to complete the proof that T{x) has a derivative 
for all values of j: for which the function is defined. Moreover, the 
F-function has a second derivative given by differentiating 14): 

rdx) ^ r rdfL\* Y 1 

r(a:) \ r{x) ) ^ + ' 


15) 
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Since the right-hand side is always positive, it follows that F'' (x) 
and r(a?) always have the same sign. Thus the graph, §2, is 
concave upward (downward) when T (x) is positive (negative). 

Eider^s Constant, The development 6) can be replaced by the 
following : 



where C is Euleris Constant: 


17) C = lim{l+4- + 4-+*‘*-f-^ -log Til. 

nan* L 2 3 71 J 

For, the product in 6) has the value: 



This product can be written as the quotient of two infinite products. 
Since 

log{ (1 + -i)f } = - * [1 - log (1 +1)], 

it is dear that the numerator product has the value The 

value of C is: 

18) C = 0.57721 66649 01632 86060 • • • 


Because of 16) we can write: 


-L_ = e^*x H (1 + —) 

W n! 


The product on the right converges for all values of Xy real or 
complex, and it defines a so-called entire function of the complex vari¬ 
able, i.e. a function that is analytic for all finite values of the 
argument. In particular, it appears from either 16) or 19) that the 
F-function has no roots, even in the complex plane. 

We have in the above another example of a convergence factory 
whereby a divergent product. 




THE GAMMA FUNCTION 


519 


is rendered covergent: 


n(>+7) 

n^i ^ n * 


X 


without disturbing the roots of the individual factors; cf. Chap. 
VI, §6. 


Exercise 


Prove the uniform convergence of the series 14) by means of 
the series 15). 

§ 4. Asrreement of the Two PefinitionSe From the 
relation: 

( t 

1 -) = 

771 ' 


it is easy to surmise that possibly 
20) lim 

The proof of the correctness of the surmise is not difficult. Let 


m 00 

lim r (i - dt^i dt (x); 

m=coJ V m ' J 


f (f, m) = (l — — ), 0<rgm; 

' Tfl * 

y’(t, m) = 0, m < t < cx>. 

Then the first integral in 20) can be written: 


21) , m) dt. 

Here: 

lim f (f, m) = 


If, then, the integral 21) converges uniformly, the relation 20) re¬ 
sults ; cf. Chap. IX, § 20, Since 


(1 — — )”= e" ‘o* (»—m ) = 
V m. ' 


3m* 


0 <t<7n. 
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it is seen that 

0 

for all values of t and m. Thus the integral 21) satisfies a ft-test: 

f. (t) ■-= t*~‘ e~‘, 

and the proof is complete. 

The integral — we now change the notation from m to n — 

0 

can be evaluated explicitly and turns out to be equal to 
x(x+ I)--‘(x + n)'* ' 

For, change the variable of integration, setting t = nX. Then 


n 




X*-1(1 - X)»dX. 


To this last integral apply the method of integration by parts: 

= ... _j^^x-»-Mx. 

Thus finally 


/■ 


t^^(l - U(x,n). 

' n ' a: -h /I 

Allow n to become infinite. It appears, then, that 

oo 

y* dt = lim TI (x, n). 


Hence the two definitions lead to the same function, T (x). 


§5. Stirlinsf^s Formula. For large values of x the function 
r(x) is extremely large. Its value can be computed approximately 
by the evaluation 


1) 


r(x) = y/2TX^^e^^€^(*K 
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where 

2) 0<a,(x)<^ 

or 

5) = 0 < e < i. 

Elquation 1) is known as Stirling's Formula, We mention also 
the following evaluation for the factorial: 

4) n\ = i/^ , 0 < ^ < 1. 


An elementary proof of the truth of 1) where 0 = ^ 1 can 

be given as follows. 

Let xs{x) be defined by 1): 


5) ta (x) = log r — (-3: — i) log X — log \^2t. 

Since 

r (jT -h 1) = 3: r (x) 

it follows that 

6) mix) — (x + 1) = log (l + — 1. 

Remembering that 




and setting 


X 1 •” y 


we find: 


^ 2x+ i' 

log (l +l) = ^_^(l +1 j—^ + l gj^,+ 


•) 


• cf. the excellent treatment of this subject by Godefroy, Theorie element 
tairt des series. Chap. VI, which we here reproduce. The reasoning does not 
show that 0 < 0 < 1, but only that 0 0 S 1. There is, of course, no loss 

in this less general theorem for purposes of computation, since 0, in the more 
general form, might conceiveably lie so near to 0 or to 1 that the difference 
would have no effect on any approximate computation. 
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Hence 

2 x+l 7) 2 ar+l ■*■ nx{x-\- !))■ 

It follows, then from 6) that 

7) 0<«(a:)-«(*+!) < 1 (1 _ . 

By a repeated application of this formula: 

0 < l)-e,U + 2) < 


0 < C5(* + /1— 1) — cjsU+n) < ---i—) 

12Va: + n—1 X + n/ 

we see that 

8) 0 < c»U)-c5(x + n) <1(1--^). 

We now proceed to show that 

9) lim cs {x) = 0. 

It will then follow from 8) on letting n = oo that* 

10 ) 

or 

10') = 0 ^ F s 1. 

Proof of 9). First, let x = /i in 8); 

11) 0 < C5 (/i) — 03 (2n) < - V « 

24 n 

We now introduce the function yjr (x) : 

12 ) 

i/2^ x^2e“^ 

^ Godefroy infers at this point that 

» <•<■>< Til- 

This relation is true, hut his reasoning establishes only the less general 
relation 10) or 10/). 
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Then 

13) CB (x) = bg ^ (x), \|r (x) = 

Since 


— ^(n)—a(2n) 

^(2n) 


it folbws from 11) that 


Hence 


1 < 


't'M < 

\|r(2n) 


1 

e24n. 


14) 


liin 


'lr(n) _ 
^(2n) 


= 1. 


Next, form the function 




^(2n) ' 

We shall show by direct computation that 


15) 


It will follow, then, from 14) and 15) that 


lim4^ = l. 

^|r(2n) 


16) = 

The proof is as lollows. From the definition of ^^(^) by 12) 
and the property of the F-function: 

F (/I + 1) = nl 

we have : 


yjr (n)^ ___ 1 2*4*6 * — 2n 

t(2n) 1-3-5--- (2/1-1)' 

Recall Wallis’s formula for r; 


Z —— — — — — 1 

2 “ 1 3 3 5 5 7 



2-4<6 

1-3-5 


• • 2 » 1 
•• (2n-l)J2n + 1 ‘ 


It thus appears that the right-hand side of 17) approaches 1, and 
that 15) is established. We see, then, that 16) is true. 
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Finally, we will show that, for an arbitrary * > 0, 


18 ) 


= 1 . 

+ n) 


We have : 


Now 


and 


(yz) _ {n — l)!e” (x + 

(x + 7i) r U -f n) * 




r (ar + n) =5 a; (j: + 1) • • • (a: + n — 1) F (a'). 
Remembering Gauss’s product: 


r (x) = lim • 


1>2.(n- 1) 


x(x 1) • • • (x + 71 — 1) 

■we infer at once the truth of 18). 

From 16) and 18) it follows that, for an arbitrary value of 

jr > 0, 

lim (x + 7i) = 1. 


Hence, from 13), 


lim CD (j: -f 7z) = 0, 


and now 8) yields 10), hence 9) — the relation we set out to establish. 
The proof of 1) under the appraisal 

0 ^ C5 (x) ^ 1 

or . 


cs (x) = 


e 

12x ’ 


0 g 8 g 1 


is complete. 

GudermanrCs Formula, On writing down Equation 6) for x, 
a: + 1, • • •,X + n and adding we find : 


ra(x)-a(x + n+ 1) =^J(x + log(l + l] 

Allowing' n to become infinite and remembering 9) we obtain 
Gudermann’s Formula : 
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19) a:(x)=£[(x + 2«|Li)log(l +_^)_l]. 

fiassO 

Binet's Series, The general term Un (jr) in 19) can be written 
\n the form : 


Un (x) = U + 

n) log (1 

L + - 
z 

1 

r 4* 

n)- 

_ 1 

1 

1 


1 

2 

X + n 

^ 3 

ix 

+ nY 

1 

1 

1 


1 

^ 2 

X -h n 

4 

ix 

+ /»)=“ 




= 2(- D' 

;»=2 


P-^ _1_ 

{p + l)-2;? (a: + nY 


( ^ _ 1 1 _2 1 5 1 

* 3*4 {x + nY 4'6 (x + n)® 5'8 (x + «)■* 

By virtue of the theorem of Chap. VII, § 5 we have: 
i20) W = (x + nY ~ WS (x + n)» 

. 3 V ^ 

5-8,^ (X + ;,)* 

Another form for Un (x) is the following: 

Unix) = - (x + n + l)log(l - ^ ^ ^ ^ 

This form leads to the development: 

21) = + 

+ -J_V < + .7. 

5-8;^j(j: + «)‘ 
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Exercises 

1. Give all the details in the above deduction of Formulas 20) 
and 21). 

2. By means of 20) and the evaluations of the series 

A- + 1 I. 

^ (m + 1)' 

given in Chap. 1, §4 and Chap. VII, §7 obtain appraisals lor C 5 (m) 



Chapter XI 
Fourier’s Integral 


§1. Fourier’s Integral. Heuristic Treatment. Let/(x) 
be continuous in the interval — oc < a: < + oo save for isolated 
values, and let 

oo 

1 ) J l/(«) \dx 

—OO 

converge. Consider an arbitraiy interval 

2 ) -I < X < I 

By means of the transformation 



the function goes over into a function of 


4) 


f(x) = Fix), 


having the same properties. In particular, the integrals that define 
the Fourier’s coefficients of Fir) \vill converge: 


6 ) 


a„ = -^J* i?’(y)cosn_y««j, b„ = ^ J* F {y) ^ny dy- 


Thus a Fourier’s development* of the fimction F{y) exists: 

oo 

6) cos + *n sin ny) 

or 


oo 

7) F{s)ds C JF* (j) cos n (s — y) ds, 

—« — 

We will now transform back to the variable x by 3). Thus we 
are led to the development: 


* We apply the term development to denote the series 6), irrespective of 
whether the series converges and represents tiie function. 
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i „ i 

8) x)dt. 

In order to bring out the central thought in the investigation 
that follows, let us confine ourselves for the present to those functions 
of the class before us, of which we know that they can be expmied 
into a Fourier’s series; i.e. the series 7) and hence the series 8) shall 
converge at all points of continuity to the value of the function. Thus 
if f(x) satisties the conditions of §1, Chap. VIlI, this will be the case. 
Formal Deduction of Fourier's Integral, Let 


9) = 

The series in 8) now takes the form: 

10) ““2 f f{t)cosn^a(t ^ x)/iadt. 

If we consider a function ^(a) continuous for 0 S a, and divide the 
interval 0 § a € ^ into m equal parts, Aa = A/m^ then the sum 

m 

11 ) 

ii»l 


approaches the limit 

12 ) 

when m = oo. The series 


A 

^ if {a) da 


2^ ^ (ttn) Aa 

ii—i 


when Aa approaches 0, suggests the integral 

OP 

^^ (a) da. 

Thus the expression 10), when I becomes infinite, suggests the 
integral: 


13) 




(t) on* « (t — x) dt. 
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This is known as Fourier^s Integral. It converges, under suitable 
lestrictions, to the value/(x). 

§ 2* A Lemma* Lemma. Let the function c (x) be continuous 
for 0 <. X <. + oo, save for isolated discontinuities, and let either 


converge absolutely; or 

iii) 


/ 

G 

/ 


ip {x) dx 


ip {x) dx 


converge absolutely, where G is an arbitrary positive constant; 
112 ) ip{x) decrease monctonicaUy toward 0 as x increases: 

f S 0 S ^ 

( lim ip (x) = 0, 


where A is some fixed number. 

Let ip (j?) approach a limit when x approaches 0 from above • 


lim ip{x) ip (O’**), 

X=a0+ 


and let 


(3:) — ( 0 '*') 


be bounded at the origin. 
Then 


f s ^ 


converges to the value f ip (0"^). 

We will prove the lemma first for the simplest and most im¬ 
portant case, namely, that ip {x) has no discontinuities* and satisfies 
G)ndition i). Here the integrand (if for the present purpose f(x) is 
defined as ^ (O*^) for 3 : = 0) is continuous in the region 
R OSx, —•oo<a<+<», 

and the integral 


e The proof applies, however, to die case that fix) has isolated discon- 
tinuities and is bounded at each one of diem. 
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14) 


oe 


{x) cos ax dx 


converges uniformly for all values of a, as is seen by setting 

/t (x) = I U) I- 

Hence 14) itqtresoits a continuous function, and furthermore 


15) 


oe 00 

^da^ <p {x) cos ax dx'=^ ^ ip (x) dx. 


We proceed to show that the integral on the right of 15) con¬ 
verges toward ? tp (0*^) when q tends to infinity. Write 

16) = 

Since, by Chap. IX, §22, 

we see on making the change of variable t qx that the first integral 
on the right of 16) has the value f ^ (0"^), no matter what value q 
may have. 

The second integral can be written: 
h 

18) 


/ 




CO oo 

f ^^dx. 


Let € > 0 be chosen arbitrarily. Then h can be so determined that 
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Moreover, 



and so 

oc 

-V>(0+) J* < £, g <7. 

As regards the first integral in 18), its limit is 0 as 7 increases; 
cf. Chap, Vni, § 2, Ex. 5. Hence it remains numerically less that 
€ when <7 ^ ft', and so the whole sum 18) is numerically less than 
3 €. This completes the proof. 

Exercise 

Let c (:c, £) be continuous in the region 

0<x<oo, A ^ i ^ B. 

Let the limit 

lim ip{x, i) = ip ( 0 +, 1) 

x=0+ 

exist for each Let <p ( 0 +, 4 ) be bounded. Let the function 
^ {x, 4) = 

’ X 

be bounded in the region 

0 < X < c, A ^ i ^ B, 
where c is a positive constant. Finally, let the integral 

1 f> {x, 4) 1 dx 

0 

converge and be bounded. Prove that the function of ( 7 , £) 
represented by the integral 15) converges uniformly in the interval 
A ^ i ^ B when g = co. 

Suggestion., Appraise the integral 
h 

^ £) sin gx dx 

0 

by assigning an arbitrary € > 0 and dividing the interval 0 ^ :r S A 
bv the points 

xo = 0 < Xi < • • • < < x„ = A, 
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to choMU that, if 

♦ (*, I) = ♦ (^*. I) + 4*. ^ X ^ Xi+i, 0 ^ k < n, 

we have: 

U*l< c. 

§3. Continuation. The General Case*. We turn now to 
the most .g^eral class of functions f (x) admitted by the Lemma* 
and proceed to establish 15), §2: 


19) 


rr 00 oo 

C ^ ^ ~ 9 (^) dx. 

0 0 0 


first and foremost it is seal that the integral 

" r 

I if (x) cos ax d'x^ 0 < /t, 

converges, since i (x) is continuous except for isolated singularities and 

h 

dx 


J* 1 V W 


converges. Ginsequently 


oo 

J* v(*) 


cosdxdx 


converges in Case i) because it converges absolutely, and in Case ii) 
because it is an alternating integral. 

The function defined by this integral, 


20 ) 

is continuous. For 


oo 

«(«•)= J* 9 


(x)cosax^x, 0 < a, 


n 

21) a (ao + Aa) — «(ao) y(x)[cos(ao + Aa)x — cosaox]rfx 


• It is well to defer the study of diit section till the rest of tiie duqpter 
has been eompleled. 
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(x) cos (oq + Aa) X dx 


oo 

-/ 


{x)cos(tQxdxy 


0 < aot 0 < ao H- Aa. 


Each of these last two integrals can be meule less numerically than € 
by a suitable restriction of Aa and a proper choice of h, as follows. 
In Case i) it is sufficient to choose k so that 


J* 1 9{x)\dx < 




h 

no restriction on Aa being needed. 

In Case ii) let y be chosen so that 0 < y < ao, and let Aoc 
be subject to the restriction ao + Aa > y. Let h A, Chap. IX, 
§21. Then, since. 


oo 

!/>■ 


22) I I ^ (x) cos OLx dx 

it is enough to take h so that 

23) 


2w{h) 


a 


y 


0 < a, 


Since h is now a constant, it is possible further to restrict Aa 
so that the first integral in 21) remains numerically less than €, 
when I Aa | < ; as is seen on removing from the interval of in* 

tegration (0,/t) short segments including the points of discontinuity 
and applying to the oontributions to the integral arising from these 
the appraisal: 


24) cos (ao + Aa) a; — cos a© = — Aa sin (ao + 0 Aa), 


The proof of the continuity of oo (a), 0 < a, is herewith com¬ 
plete. (a) is not, however, necessarily bounded, as is shown by the 
example 



Next, we need to show that the order of integration can be re¬ 
versed in the integral 
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25) 




(p {x) cos (txdx. 

Y 0 

The proof is not difficult and can be left to the reader. 

We are now prepared to show that the order of integration can 
be reversed in the integral 


26) 




{x) cos Oixdx, 0 < y. 

Y 0 

Write the inner integral in the form: 

DO /t OO 

cos ax dx = ^ ip {x) cos ax dx ^ ip (x) 

0 0 h 

Choose g in Case i) so that 


cos ax dx. 


CO 

J* lf(*)l 


in Case ii) so that g ^ A and 


dx < 


< €. 


Thai 


oe 


cos axdx 


< €, g ^ K V ^ a. 


Thus we see that 


f/ OO ^ it 

j j da J ip {x) cos ax dx — /f( x) dx J 

Y 0 0 Y 


cos ax da 


0 OO 

I da. ^y* ^ (x) cos ax <ix j < (9 — y) «, g ^ h. 

This proves that the order of integration in the integral 26) can 
be reversed, and hence we infer the relation: 


28) 


/ r 
J ^ 


(x) cosaxdx^ 



FOURIER’S INTEGRAL 


355 


eo oo 

0 0 


The last integral in 28) approaches 0 with y. For, 

oo h CO 

29 ) C ^{x)±^dx= f ^(r)±^dx+ J ,p{x)^^^dx. 

0 0 A 

Let € > 0 be arbitraiy. In Case i) it is sufficient to take h so that 


flO 

J* 1 U) I 


dx < €. 


In Case \\) h A can be so chosen that 




dx 






dt < €. 


And now, holding h fast, we see that y can be so restricted that 
the first integral on the right of 29) remains nuriierically less than €. 

If, then, in 28) we allow y to approach 0, the right-hand side 
approaches the first term as its limit. Hence the left-hand side con¬ 
verges and we have 19), or i 


30) 



ff (x) cos OLX dx = 



^^j!±dx. 

X 


The final step consists in showing that the integral on the right 
converges toward ? ip (O'*") as q increases. The proof begins as in § 2 
and we reach 18). In Case i) the last two integrals can be appraised 
as in the earlier proof. In Case ii) we have, by Chap. IX, § 21 : 



sin qx dx 



A g //, 


since the function ip {x)/x decreases monotonically toward 0 as r in¬ 
creases. It is sufficient, then, to choose h so that 

< €. h. 

h 

The third integral in 18) is appraised as before, and so, in each case, 
there remains only the first integral, with h fixed. With the aid of 
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tlie Exercise of Chap. VIII, § 2, there is no difficulty in proving that 
tiiis integral remains nnmericalJy less than € when q exceeds a suit¬ 
able integer, p. ^ and the proof of the Lemma is now completa 

§4 Convergence of Fourier’s IntegraL Differentiation. 

The most important functions which can be represoited by Fourier’s 
integral belong to one or both of the following classes. 

Class I. /(a:) is continuous except for isolated singularities and 


J \fi.*)\dx 


converges. 

Class II. f{x) is continuous except for isolated singularities and 

h 


a) 


j i/(»)i 


dx 


converges, where b are two arbitrary numbers; 

0) f{x) converges monotonically toward 0 when x = + oo, and 
also (though not necessarily with the same sign) when =s — oo. 

Theorem of Convergence. Let fix) be a function bdonging 
either to Class 1. or to Class II. Let x be a point such that 

lim / (f) = / (x+), lim / (t) = / (x~). 

Let each of the difference-quotients: 

f{x + h) -/(x+) 
h 


0 < A < (T; 


+ -S < h <0 

h 


be bounded. Then 




(0 cos a (t — x) df = J [/•(x'*') + / (x“)]. 


If, in particular, the function is continuous at the paint x, then 
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The pioof follows immediately from the Lemma. Make a change 
of variable: 


11=^ t — X, 


e« oo 

//w COS a(^ — x) dt = ^ f {x u) cos audu. 


and apply the Lemma. 
Next, let 


=/U + 


^ — a: = — M. 


X 00 

f{t) cos ait ^ x) dt ^S^ 

—oo 0 

Set 

V (“) =/(« — «) 

and apply the Lemma. Thus the proof results. 

Differentiation, Let f (j:) be a function which meets all the con¬ 
ditions of the above theorem and, furthermore, is continuous without 
exception. Let it have a derivative which also satisfies the conditions 
of the theorem. Then, in an interval a <. x <. h m which the 
derivative is continuous, it will be given by the integral: 

oo o* 

ff (x) = ^ f' (^) cos a (t — .r) dt. 

0 —oo 

For, we can write Fourier’s Integral in the form : 

oc ee 

/(x) = 7 / da ^f{u + x) cos audit + 


00 0 

Caudu^ 

'> n 


and each of these latter integrals can be differentiated by Leibniz’s 

rule. 
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§5. Derived Integfrals. It is possible to break the Fourier’s 
integral up into two integrals as follows: 

oo oo 

/U) = —J* da. J*fit) ms a. {t — x) dt = 

U *~oo 

oc oc oo oe 

mscLx da. ff(t) COS at dt ^ sin ax da ^ f{t) sina^^^ 

0 "~oo ^ 0 “OO 

In case f (:r) is an even function or an odd function these in¬ 
tegrals can be simplified. 

Case I. =/(— -r). Here the last integral vanishes and 

the first can be written in simpler form : 

oo oo 

/(^) = —cosax da ^f{t)cosatdt, 

0 0 

Case II. f{x) = — /(— x). Here 

oo oo 

/w = f/ sin ax da Cm sin at dt. 


Example 1. Let 


/w = 


— Arof 


0 < 


0 < ki 


/(- x) =/(;r). 
This example comes under Case I. Since 


oc 


cosat dt = 




we have: 




Thus 


oc 

/ cost 
k- 4- 




A 0. 
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Example 2. Let 

/(x) = c"** 0 g X, 0 < A-: 

/(- x) = -/(x). 

This example conies under Case II. Since 


sin futdt 




we have : 


oo 

- 2 /* OL sin (X X 


< ar, 0 < k. 


Thus if 7 ^ 0 : 


oo r 0 <a:; 

/ asinao: , 1 

A- + 1 ~ ®' 

0 x<0. 

Example 3. Let 

/(x) = x~* 0 < X, 0 < A < 1 ; 

/(- x) =/(x). 

Then 

oo oo 

^ cos (feX da* ^ r”* cos dt. 
Change the variable : u = at. Then 


CO 

-A 

X ^ = — f a 
TT «/ 


* ^oosaxda I u ^cosudu. 


In particular, if a: = 1 : 


Let A = J : 


oo oo 

f r COS a da ^ f Pcosudu^ t 

LJ J J = T- 

00 . 

/ cosxdx _ fr 

. "7t “ KT- 



5^ 


FUNCTIONS OF REAL VARIABLES 


Riemann has given the following ingenious determination of the 
±-sign. Write 


and in the integral 


oe 

/=i/ 


r cos X 


V X 


make a change of variable : 


If, now, we set 


X = a fir. 


Fia.) = -L - - * + —4 


we shall have : 


1 / a *j/ a + r |/a + 2 r 


OB 

^ F(a)cosaifa, 


J J - 

provided the series can be integrated term by term. Now 

It f It 

Hi 

In the last integral change the variable of integration to r — oi. 
Thus we find: 

< f 

J Fia,) cosa^a = f [Fid) — F(r — d) ] cos a da*. 




1 r 1 


2 


and so JP' (a) < 0. Henoe 


[F(») - F{r - ft)] = F(ft) + F'(r - ft)< 0, 
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and, since F(a) — F(r — a) = 0 when a. = r/2, we have : 

0 < F(a) — F{r — a), 0 < a. < ^. 

Consequently the upper sign is to be chosen. 

It is left to the student as an exercise to justify the integration 
and the differentiation of the series term by term. 

Example 4. I^t 


Then 


f{x) = a:*, 0 <j:, 0 <*<1; 

QO OO 

a:*"* = ~^ sin ax da ^ sina^d^r. 


Set at. Then 


If 1, 


Let A: = ^: 


OO CO 

^ a^^ sin ax da^ sin udu, 

^0 0 

oe OO 

/ sina^g E sin u du _ r 

J M* ~' 2 ' 

0 u 

/ sin g da _ 

_ ■,/« "Kl-- 


§6. Fourier’s Integral for Functions of Several Vari¬ 
ables* I^t f (j:, y) be continuous, togetlier with its derivatives of 
the first order, throughout the whole plane, and let the integrals 

OO oc 

*) J \f(x,y)\dy, ^ \f{.x,y)\dx 

» 

converge. Then from § 4 we have : 



342 


FUNCTIONS OF REAL VARIABLES 


Hence 

2 ) 


OD eo 


fi.x,y) = -^C da.J* f{i,y) cos a (€ - a:) </£, 

0 

oo oo 

/(4.r) = “ f ^ /(4.3)cos3(i| —y)dn. 

0 “OO 


f{x,y) = 


or CO oo oo 

^J*J*tf) cosaii — x) co»fi {ti — y) dtf, 

0 —oo 0 “oe 


with a similar formula, in which the integrations with respect to 
a, £ and t} are interchanged. In either of these forms, certain 
^scontinuities of the function fix^y) and its derivatives along reg¬ 
ular curves can be admitted. But the more important form of the 
Fourier’s Integral is the following: 

3) /Ur) = 

00 OO OC OO 

f|) cos a (£ — ar) cos fi(fj -- y) fitj. 

0 0 —oo —oo 


This form can be obtained in the above restricted ('ase of excep¬ 
tionless continuity, provided the further requirements are laid 
down : —• 

The integrals 

oo oo 

4) J* \fix,y)\dy, ^ \fAx,y)\dy 

—oo —oo 

shall converge uniformly in any finite interval, ^ x ^ cl\ And 
similarly, 

oo ee 

5) J \f{x,y)\dx, J* \fy{x,y)\dx 

~oe -oo 

shall converge unifomily, V ^ y ^ Finally, one of the in* 
tegrals: 
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o» oo oo oo 

6) ^ dx^ \f{x^ y) I dy^ \f{^, y) I dx 

— oo —CO —oo —OO 

shall converge; then the other does, also. 

The proof is as follows. It is sufficient to consider the integral 

oo oo oo 

7) ^d^ ^y (£t «j) cos ot£ cos 


0 0 0 


oo 

— ^ cosa4 cos pi) di). 


Then we wish to show that 


OO OO CO oo 

f dij F(S,p)*/p Fii,fi)di. 


First of all, observe that 


^ oo oo j; 

J dij F(£,p)dp =J*dP JF{i,&)di. 


For, the integral; 


oo oo oo 

J F(i,p)dp d^J' £) cos ptj di\. 


^1) (»|» £) =/(£» n) cos a£, 

converges uniformly in any bounded region, 0 ^ ^ G; cf. 

§2, Exercise, p. 331. And F{^,p) is continuous, 0 ^ £, 0 ^ P, 
because of 4). 

Write 


The integral: 


♦(5.P) = f F((.p)de, 

0 

oo 

J* FU,fi)di 
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oonverge$, nnoe 


o» 


This last integral defines a continuous function of £ by 4), and 


oo oo 

M 




converges by 6). We can now write: 


oo 

♦ (oo.P) = f F(l, 


From 10) we have: 


5 oo 


JdijFit 


and from 15): 


JdflJ FU,p)di = J* 4r(oo, fi)dfi. 


Hence 


5 OP 


14) F{i,fi)dfi- Jd^J FU,^)di 

VO 0 0 

oo 

= -f {♦(~,P)-♦(€,?) UP. 

0 

We wish to show that this last integral approaches 0 as £ = oo. 
G>nsider the function: 

oo 

15) <p(»l) = //<« , f}) cos 

the lower limit of integration being merely a constant. The function 
^ (i)) is continuous and has a continuous derivative. For, the integral: 

16) J l/.,(«.»l)U€ 
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converges uniformly by hypothesis, 0 < i, g c. Moreover, the func¬ 
tion/»i (5. *l) cos tt 5 is continuous. Hence the integral 15) can be 
differentiated by I>eibniz's Rule. 

Thus ip (ij) is seen to satisfy all the conditions of the Lemma 
of §2, and so 

•o oo 

n A 2 


Now, 


oo oe 

♦ (oo, P)-'if(£.p) = r FU,p)di = 


V 

as follows at once from 4), 5) and 6). Hence 


oo 




♦ (o°. P) - ^ (S. P)! dP = — / /({, 0+) cos (Hi dl. 


Finally, 


I J/(€,0+)cosa4d£ I g J* l/(£,0+)|d£, 
5 k 


and so approaches 0 as £ == oo. 

This completes the proof. We have used the hypotheses 5) 
and 4^), but not 42 ). The latter are needed when the integrations 
with respect to a, £ and ij are interchanged. 

The Case n ^ 5. I'he proof for the general case is given by 
a repeated application of the results above obtained. G>nsider the 
case 71 = 3. Here, 


00 00 00 00 00 oe 

18) /(0+0+,0+) = ^J’ d(HjdiJdfiJdrtJdyJ/a. 1.0 


cosai cos cos yido 

The last two integrals, beginning on the right, can be replaced by 
i /(£» O’**). Hence the integrals with respect to £ and fi can be 

interchanged, provided the integrals 
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on ae oe 

19) J* \f(.x,y,z)\dx, J* \f{x,y,z)\dy, J* \fy{x,y,z)\dx 

— •JO —oo —oo 

converge uniformly, each in an arbitrary bounded interval, z being 
merely any constant; and one of the integrals: 


20 ) 


00 oo 

J* y' *) I 

— oc —oo 


y, z) I dx 


converges. 

We are thus led to the integral: 


21 ) 


fdijdnjdyff 

0 0 0 0 


(£. 0 «» tt£ cos 3i) cos y c dC- 


G>nsider first the interchange of the integrations with respect to ti 
and y. Here, the integrals 


oo oo oo 

^ ^ i/(3:,y,z)ldy, J* \fx(x, y,z)\dy 

— oo —oo ~.00 


must converge uniformly in any finite interval, x being merely any 
constant, and one of the integrals 

oo eo oo oo 

J ^yj 1/^^’ y^ I S 

— oo —oo —oo —oo 


X being any constant, must converge. 

So now we come to the integral: 

oo or 00 eo 

22) j di J *^yj ^/(4.*l.C)cosa£cos^«|cos-yC rfC* 

0 0 0 0 

This integral will ha/e the value 

eo 00 oo 

25) /f (£» C) cos aj cos yC 

0 0 0 


f(€. O ==J Oaafiiidt). 

0 


where 
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provided the order of the integrations with respect to tj and t in 22) 
can be reversed. This will be possible if one of the integrals: 

oo eo oo 09^ 

— oo —oo —oo —oo 


converges. 

We wish to reverse the order of the integrations with respect 
to £ and y in 23). Let 

oo 

g (x, z) —J* 1/ (x, jr, t) I dy, 

— OO 

OO 

h{x,z)= J* \ fAx,y,z)\dy. 

— oo 

We need here to require the uniform convergence of the integrals; 




and the convergence of one of the integrals: 


oo oo oo OO 

J dx J* g{x,z)dz, 


Thus w« arrive finally at the integral; 


24) 


OO oo OO 


(€» 0 cosa£ cosyC d^. 


Since an interchange of order in the integrations with respect to f| 
and C is allowable, we obtain as the final result: 


oo oo oo eo oo oo 

25) f(x,y,z) = -^^J* da di 

0 0 0 -00 

cos a(5 — a?) cos P (ij — ^) cos 7 ( C ~“ -) ^C* 
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Differential Equations. Existence Theoremb 


§1. The Problem. Consider the simplest case, 

^=/Ur)- 


I^t f{x^y) be continuous in a region 5 of the (.r, jK)"pb'uie, the 
boundary points not being considered as belonging to the region. To 
each point {x^y) of 5 shall be assigned a direction, the slope of the 
line being defined as the value 
of f (x, y ). It is cx)nvenient 
to visualize these directions by 
means of short vectors drawn 
from the points. Thus we have 
spread out before its a two- 
dimensional family of tliese little 
vectors. 

By a solution of the dif¬ 
ferential equation 1) is meant 
any function 

2) y — v W 

such that the point {x^y) lies in 5 and the equation obtained by 
substituting the function 2) in 1) is identically true: 



3) [x)^f[x, ip (x)\ 

Thus ip {x) must have a derivative, and from 3) this derivative must 
be continuous. 

The graph of the solution 2) is a curve which courses 5. At 
each one of its points it is tang^t to the little vector pertaining to 
this point. 

The question now arises, is there such a curve through each point 
of 5, and is there more than one such curve? The answer to each 
question turns out to be affirmative. This gives us half of what we 
want — a solution through each point The other half is )ust what 
we do not want — more than one solution* 
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For example, consider the differoitial equation: 

4 ) 

The function 

5) y = 9 (*. a) = (t - tt)* 

is seen to be a solution; but it is not the only solution, for 

6) r = f ^ 

is also a solution; but the functions 5) and 6) do not exhaust the 

possibilities ; for, through an arbitrary point of the plane there passes, 

not one, but an infinite number of solutions. Take the point (1, 1), 
say. Through this point parses the solution 

jy = x’, 0 ^ X ; 

but for X < 0 there is an arbitrary stretch^ of the x-axis, 

^ = 0, a < X <C 0, 

where a is any negative constant. And then, finally, 
y = {x- af, X ^ tt. 

A similar situation exists for every point of the plane; and yet 
the function f{x,y) = is continuous without restriction, S being 
here the entire plane. 

We can forestall the occurrance f>f ^nltipU c/^lnti pns by i mpos- 
ing a further restriction on It is sufficient to demand that 

f pos«ess a derivative with respect to jy, 

and require that it be continuous** in S, 

All that has been said can be extended at once to the general 
case of n simultaneous differential equations of the first order in n 

• In particular, this stretch can extend to — oo, or be replaced by a point. 

«» 0 . 

•• This condition can be lightened; it is enough thatbe bounded. On 
the other hand, still bghter conditions can be imposed (the so-called Lipsehitz 
conditions). But in practice the condition of the text is fulfilled, if such a 
condition in any form is present, and so we choose the simpler requirement. 
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dqiendmit variables; cf. § 3. Thus when n = 2 we have: 

7) ^ “ F(x,y,z), ^ 

the functions F, ^ being continuous in a three-dimensional region F 
of space, which shall ^lot include any of its boundary points. To 
each point of F shall be assigned a direction whose direction com¬ 
ponents (1, are suggested by writing 7) in the form: 

Qv dx dy dz 

1 “ F ^ * 

Thus we have before us a three-parameter family of little vectors. 
And now a solution of 7) will be given by two equations: 

9) ^=/W. z = f{,x). 

Geometrically, these equations represent a curve in space, coursing F^ 
and such that, at each of its points, it is tangent to the little vector 
pertaining to this point. 

§2. The Existence Theorem. Theorem. Consider the 
differential equation 

1 ) 


where f{x^y) is continuous in an open region S of the {x^y)- 
plane^ and has a continuous derivative^ 


if 

dy 




Let (xq, ^o) ^ ^ arbitrary point of S. Then there exists a function. 


2) y —9 W. 

having the following properties: 

i) ip {x) has a continuous derivative in the neighborhood of the 
point X and takes on the value y^ there: 




ii) ip{x) satisfies the differential equation 1) throughout the 
neighborhood: 

3) (*)J; 


iii) The function ^{x) is unique. 
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The proof is given by the Method of Successive Approximations. 
Form the functions: 


4 ) 


yi /(■», h) dx + b, 

a 

X 

Ti =J* f(x,yi)dx + b. 


yn 


=J* fi^^yn-i 


)dx + b, 


where a = Xq, b = I.et 

Jt: U-ul g A. \y-b\ g B 

be a region lying in 5, and lei 

5) \f{x,y)\^M, \f^{x,y)\^ G. 

Then 

X 

\yi — b\ I /(x, b)\dx ^ M (x - a) 


'\l a ^ X, and in any case, 

6) \yi-b\ g M\x^al 

Now, if yi is to be available in the integral which defines jyoi 
the point must lie in 5. This will surely be the case if we 

restrict x to the interval 

7) u — h<.x<a-\-h, 0 < h ^ Ay 



choosing h so that 

8 ) Mk g B. 
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Proceeding to we see in the same manner that 

r 

1 Jo — i 1 g J* \f{,x,y{)\dx^M\,x — a) 

a 

when a S x <, a + and generally: 

\yz — b\^M\x-a\, |jr-a|<A. 

And so on; 

\yn--h\^ M\x — a\, \x --- a\ < h, 

or 

9) b-^B<,yn<h-)rB. 

Thus all of the functions yn ai*e defined in the interval 7), the 
point Cr, lying in 5- These shall be called by courtesy the suc^ 
cessive approximMtions, and we will now show that they deserve 
their name. For, the function yn approaches a limit as n becomes 
infinite. To prove this, let us write 

10) J» = A + (JI — Jo) + (J 2 — Jl) 4- • • • + (J» — Jn-i) 

<ind test the infinite series : 

11) b + (ji -j„) + (Jo - Jl) + • • • 

for convergence. We have : 

J» — Jn-l = J Jn -1 )—/(*, Jn-o)] dX. 

a 

Now, 

lii) /(*. Jn-l) -/(*. J»- 2 ) = iXn -1 - Xn~3)fy (x, Y), 

where Y lies between y„^i and yn^* Hence (x, Y) is a point of JR, 
and 

13) \fy{x,Y)\^G. 

We see, then, that 

r 

14) 1 Xn - Jb -1 \ = j G\ J„_i - J,^^ I dx 

a 

w'hen a £ X < /K + A, and a similar reLition holds when x is less 
than a. 
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Begin with n = 2. With the aid of 6) we have: 

X 

\yi- yi \ ^ mg J*(x-a)dx = MG^^-:^ 

a 

when a ^ X •< a and generally: 

15) \y 2 -yi \ = \x-a\<h. 

Repeat the reasoning for n = 3; and so on. We arrive at the 
result: 

16) \yn-yi^i\ g lr-al<A. 

n\ 

From 16) it follows that 

17) \yn-yn-i \ g MG'<-^^. 

Til 

The right-hand side of this last inequality: 

18) - M„ = MG'‘-'^, 

ni 

is the general term of a convergent series, and hence the series 11 ) 
converges. But we can infer more tiian this. The quantity Mn is 
independent of x. Hence the series 11 ) converges uniformly in the 
interval \x — a \ <. h, and since the terins of the series are 
continuous functions, the limiting function : 

19) <p (x) = lim i + (j, — 7 - 0 ) + ( y-i — Ji) + • • • 
is continuous in this region. 

Does (p (x) have a derivative, and if so, does it iiave the value 
ipf{x) (x)] ? 

The first question is answered in the affirmative by the genertil theorem 
for differentiating a series term-by-term. Chap. V, § 9, for all the 
conditions of that theorem are fulfilled. In particular. 


20) 


(r» - y«-i) =/(*.rn-i) -/(^.rn-a) 

= (r«-l - yn-i)fy y), 
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- I g 


(n- lyi’ 


Thus the term-by-term dmvative series converges uniformly, and its 
terms are continuous functions of x. 

It appears, then, that each of the double limits: 


d_ 

dx 


lim yn-, 

Itaoo 


lim^ 

naoo dx 


converges, and that they are equal to (jr), for this is. precisely what 
the differentiability of the series term-by-term means. Hence, in 
particular 

tp* (x) = hm /(x, y„_j) = / [ x, y) (x) ], 


the last equation following from the fact thaxf{x^y) is continuous 
in the point x = y ^ <p (ar'), and ^n-i converges. Thus the 
answer to the second question is justified, too. 

Uniqueness, It still remains to prove that the solution we have 
found by the foregoing method is the only solutirn, I-et 

21) Ii=:^(x), 

and let 

22) ^ li + = * (or) 

be any second solution. Then the two functions are identical in the 
whole interval a h) i 

23) 0 (j:) — ^ (x) s 0, 0 ^ a: — a < ^, 

or 

If this were not the case, there would be a point £ : 
a S £ < a + A, 


such that (7 sH 0 when ^ x ^ £, but for any interval 


£ <x< £< fl-f-A, 
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however short, there will be points for which U ^ 0. 

Plot the curve 

X=‘\u\. 

Ijdt { < < 4 be a point for which the corresponding value CIi 

of U does not vanish; 


0 < I c/i 1. 

Consider the roots of the equation 

\U\ = \Ui\ 

which lie in the above interval. There must be a smallest root, Chap. 
Ill, § 8, Ex. 6. Denote it by ij = £ 4* y. Then 


\TJ\ < U/il. 


i ^ X < tf. 


Now, 


Hence 


dn /*/ 




^ =/(^. w + ^'-'0 —/U.«) = {x, r), 


where Y lies between u and u U. 
Integrating, we have: 

A 


t/i = 


Ufyix, 


,Y)dx, 


1 I ^ 1 1 

l ^ Gy. 

Rut fr > 0, and y ciin be chosen arbitrarily small. From this cx)n- 
tradictioii follows the truth of the theorem. 

Similar reasoning applies to the interval (/i — Ka)\ or this case 
can be referred to the one just treated by a transformation, V = — r. 
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Exerctsks 

1. The solution 2) of the differential equation 1) is a function 
not only of x but also of (^Tq, ^o)- Holding Xq = « fast and letting 

vary, show that the solution, 

y = u (x,b), 

is a continuous function of the two independent variables (jr, ^). 

2. Ijet f(x^y^ai) be continuous, together with fxix.jr^Oi)^ in 
the neighborhood of a point jy'o* ®'o)- Show that the solution of 
the differential equation« 

which passes through the point (xq, Xq) : 

y — <p{x, a), 

is a continuous functions of (x, a) in the neighborhood of the point 
tto)- 

Hold Xq fast, but let Xq b he a continuous function of a.. 

3. If to the hypotheses of Question 2 are added the existence 
and continuity of the derivatives* 

and also oi b ^ b (a), show that the function (p {x^ a) admits a deriva¬ 
tive with res]3ect to a, continuous in the neighborhood of {xq^olq), and 
that the same is true of the function (x, a). 

4. Given the differential equation 

= xe^ — x^^^ 4- sin X + log (1 4- x“)* 
ax 

Show that it has a unique solution passing through im arbitrary iX)int 
of the plane: 

jy = V' U; Xq,XoX — co < x < oo; 

and that the corresponding curves sweep out the entire (x,;y)-plane 
just once. 

* Cotton hat given a more general theorem, the derivatives of the second 
order not being required to exist; cf. $ 4 and Goursat, Cours d’onniyss mathi^ 
vol. HI (1915) § 460. 
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§3. Continuation; n Equations. Thkobem. Consider the 
simultaneous system of differential equations: 

0 A =1, •••,«, 

where * **' Xn) w continuous^ together with its derivatives 

of the first order with respect to y^^ • • •, yn% in the neighborhood of 
w point (/z, bn)» Then there exist n fimctions: 

2) n =. v'l (*). • • •. rn = <pi.U) 

having the following properties: 

i) (^) litis a continuous derivative in the neighborhood of the 
point X a and 

<fk («) = hf 

ii) These functions satisfy the given system of differential 
equations: 

V *(*)=/*[*. f*! (*). J. k — 1, 


iii) The functions 2) are unique. 


The proof given in § 2 for the case n = 1 is applicable in sub¬ 
stance, the requisite extensions being adequately indicated in the case 
n = 2, to which we now turn. Let us write the system 1) in the 
form : 

3) r(,x,y,z), ^ —^{,x,y,z), 

d'x dx 

the functions being continuous, together with their first derivatives 
with respect to y^ z, in the region 


R-. \x— a\ ^ j 4, \y — b\^B, \z — c \ ^ C. 

Moreover, let 

f 1 F{x,y,z) \ g M, \^{x,y,z) \ g M; 

4) j 

^ \ Fy{x,y,z) \ ^ G, •••, 1 1 g G. 

Form the approximations : 
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5) 


ri = / F (x, c) dx + zi = ^ $ {x, h, c) dx + C\ 

a a 

X 

y” — J* ^ 

a 

X 

Zn = J* 9 (^. r»-i> z»-i) rfar + C. 


restricting x to an interval 

6) -- k < X < h, 0 < h ^ 

where h is so chosen that 


7) Mh £ B, Mk ^ C. 

To examine the limits: lim yn and lim Zn, write 

yn = b + iyi- yo) + (^2 - ri) + • • • + (yn - yn-i). 


Z„ — C + (zi — Zo) + («2 — «l) +-1- (*» — 


where = b, Zq c, and study the infinite series : 

8) b + iyi - yo) + {y2-yi) 

9 ) c + (zi — ^o) + (22 — *1) H-• 

We have from 5) the appraisals: 

10) \ yi — b\ ^ M\x — a\, \zi — c\ ^ M\x — a\. 
Furthermore, 

X 

yn — r»-l ^ (*• r»-l* *"-l) “ F (*. :> n-2. *»-2) ! 

a 

By the Law of the Mean: 

- F{x,y^,Zn^ = 
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1 JKn—2) 2^) (^n—1 “ •2^—2) (^1 2^)* 

Ry virtue of 4): 


11) I F(Xy Z„^i) — F (x, ^/»-2) 1 ^ 


^i 1 r»-i ““ r/*-21 + I ^-1 - ^/i-21 }• 


Hence 


12) I yn - yn-l 1 ^ ^ ^ i I .>"-1 “Jb-S I + 1 ^"-1 -«n-2 I ! fl*-, 

a 

and similarly: 

X 

13) I Zn — Zn-i I g ^ <r j I y„-i - yn -2 \ + 1 2 „-i - 2„_2 | j dx, 

a 

where a ^ x <, a with a similar relation if a -- h <, x < a. 

For 71 = 1, these appraisals are replaced by 10). When ti = 2 
they yield with the aid of 10): 

14) \y2-yx\^ 2MG l2,-zj 


And now it is shown by mathematical induction that, generally, 

r \yn-yn-i \ ^ M(2G)”-t l . ^-^l" , 

15) I 

\.\z„- M (2 G)"-^ l^~ ... ?i" . 

where x lies in 6). In particular, then : 

16) 1 - r n-l 1 = M„, \z„- Zr.-i \ g M„, 


where 

M„ = M(2G)"-i^ 
n\ 

The series 

X Mn 

n 

converges. Hence the series 8) and 9) converge. Moreover, their 
terms are continuous and the series converge uniformly. By Chap. 
V, § 4 they define functions: 
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( Vix)=b + (xi— Xo) + (^2 — ri) + • • '• 

17) { 

'• (x) = c + («1 — ^b) + — 2i) H-. 

continuous in the interval 6) and such that 

I y (x) — 3 I s jB, 1 (x) — c 1 ^ C. 

These are the limits sought: 

18) lim Xn = V U). lim x„ = (x). 

11=00 wa o o 

Jt remains to show that these functions have derivatives and satisfy 
the given system of differential equations 3). 

The series 8) and 9) can be differentiated term-by-term. For 

^ {yn — Xn-l) = F{x,Xn-U 2 «-l) — F (x, Xn-l, Zn-i)- 

From 11) and 16) it follows that . 

4- h'n - yn-l) I ^ 
ax « 

Hence all the hypotheses of the theorem of Chap. V, § 9 are fulfilled, 
and so <r (x) admits a derivative: 

f'(•») = 5^ } F (x, Xn-1, Zn-i) — F (x, Jn-a, z„_2) j 


= lim F(x, Xn, Zn) = F[x,(p (x), f (x) ]. 

IfaaOO 

Similarly, 

V (x) = * [ X, (x), yy (x) ]. 

Thus a solution, 

19) y = 9 W. z = yy{x) 

of the given system of differential equations 3) is obtained. 
It remains to prove the uniqueness. Let 

M = fP (x), v = yff (x), 


and let 


« + U = * (x), 


» + F = *(x) 
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be any second solution. Th«i 

+ U.i; + F) - F(,x,u,v) 

^UFy {x, r, Z) + ^ F. {x, Y, Z). 

and similarly: 

(x, r, Z) + F9^ (x, Y, Z). 

We wish to show that C7, r vanish identically. If th^ do not, 
suppose that 

<»(x)=lUl + |r|=0, a£x^i<a + h-, 

®(*i) 9* 0, £ < xi. 


where Xi can be chosen arbitrarily near to |. Let •) = £ + y be the 
snisJlest root of the equation 


Let 

Then 


» (x) = CO (xi). 

Ui=J\ UFy + FFz\dx, 


It^il ^ G{|t7,| + lr,|}y; 

and similarly, 

I I ^ G {I U, I + I Fi I j y. 

Hmce 

\\Ui\ + \F,\] ^ 2G\\U,\ + \F,\\y, 

or 

1 ^ 2Gy. 

Since y can be made arfaitFarily small, the proof of uniqueness is 
oompletieo 
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Exercisks 


1. Show that, under the hypotheses of the Theorem, \vh«i 
n = 2* there exists a sub-region 

A': \x-a\£A\ \y-b\^.Br, \z-c\^(^, 

and a positive constant such that, if (jto, Joi arbitrary 

point of there is one and only one solution of the differential 
equations 3): 

y = f {x\ xa, y^, Zq), z = <p{.xi xo,yo,zo), 
defined throughout the interval 

— A' < X — xo < A', 

\vith f (xo; xo, ya, Zq) = 9 (^o; ^oi ro» == 

Generalize to the case n ^ n. 

2. Cariy through the detailed proof in the general case, n = n. 

3. Extend the Exercises of § 2 to the general case of this par¬ 
agraph. 

4. Let the function of the system of dif- 

fer^tial equations 1) be continuous when x lies in the interval 

a X h 

and yu * *' ^ yn «re unrestricted, and let the first derivatives of fk with 
respect to the ^’s be bounded. Show that through an arbitrary point 
(jtq, y^, • • •, yt?) passes one and only one solution 2), defined for the 
whole interval (a. A). 


§4. The Semi-LJnear Case. Let the simultaneous system:* 


be giyen, where f{x^y)j 9i^,y)f are continuous in the 

neighborhood of a point (a, A), and where, moreover. 





• cf. foot-note, p. 356. 
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exists and is also continuous there. The first equation admits a unique 
solution, 

2 ) Y^ip(x\ ip{a)^h, 

in the neighborhood of the point x ^ 


3) 


a — h < X < a -)r h. 


When this function is substituted for y in the second equation, the 
value of h being conceivably cut down, so as to bring the point 
(x, Y) within the above neighborhood, the latter becomes a linear 
differential equation in and it ad nits, for an arbitrary initial 
value, z := c, a unique solution Z, defined throughout the whole in¬ 
terval 3). Thus 


4) 




y^ = Zip{.x,Y) + ^{.x,Y). 


So far, then, as the solution of the simultaneous system of dif¬ 
ferential equations 1) is concerned, there is nothing left to be desired. 
By means of the resulting functions, which satisfy Equations 4), we 
proceed to develop a 


CoNVKRGBNCB Thborem. Let a sequence of successive approx¬ 
imations he defined as in §§ 2, 3 .* 


5) 


X 

Xn =ff{x,y„-i)dx + b, 

a 

X 

^—f{ iP Idx + C, 


with y^ — h and = y* y is arbitrary. Then 

lim = r {x), lim Zn — Z (x). 

fimmoo nmm» 


Moreover, yn=^ yn{x) and Zn — Zn{x) converge uniformly 
in the interval 3). 
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So far as lim yn is concerned, the proof comes under the earlier 
case. As regards lim Zn^ write from 4): 

X 

Z = J \Zf{x,Y) + yy (x, Y)\dx c, 

a 

and folrm the difference: 

6) Z - = 

X 

^\Z<pix,Y)-z„.i^(.x,yj^i) +^^ix,Y)- ^{x,y„^i)\dx. 

m 

Set: 

c 9 (x,yn) = {x, Y) + t„, 

^ (x, yn) — 'j/’ («, r) + C». 

Since yn (^) converges uniformly in the interval 3), we have; 

I tn I < •». K» 1 < •». m ^ n, 

where fj is an arbitrary positive constant, and m is independent of :r. 
Rewrite 6) in the form : 

X 

7) Z-Zn=J \<p{x, y„-i) (Z - z„_i) - Z C „_1 - Cn-i } dx. 

a 

Let € be an arbitrary positive number. Then i) can be so chosen 

that 

8) 1 — Z Cii-i — tUi I < 6. m ^ n, 
where x lies in 3) and m is independent of x. Moreover, 

1 )| 

where G is a suitable positive constant. Hence 

X 

9) \Z — z„\S ^ \G\Z — I + c } rfjp, m ^ R, 


a X < a + A. 
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Let ilf be so chosen that 


G1 Z - 2 ,„_i 1 + e ^ M 


when X is in 3). Then 


Z — Zm| ^ Mix—al. 


From 9) we now infer that 

|Z-z™+,| g MG l^~?l" + €|x-a[. 

By mathematical induction it follows that 

10) |Z-^IS + 

Hence we arrive at the final appraisal: 

11) |ZI < MG-+€(«*-!), 

and the G>nvergaice I'heorem is established. 

Both theorem and proof admit an immediate generalization: — 

CoNVERGENXE THEOREM. GsNERaL Casb. Let the system of 
simultaneous differential equations be given: 

•••,ym\ Ar= 1, •••,/«; 


7 = 1 , •• •,/, 

where /*, are continuous throughout the neighborhood of a 

point (tf, • • •, ^m), nnd where^ furthermore^ the derivatives 

*,tt = 1.•••,»», 


exist and are also continuous there. 

Form the successive approximations: 
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*0 

1^) , /* / » 

= J (4"“'* V*} (*> M"-*’.- • •. r-r*) 

jfo "* 

^ + f; (x, jl""' >,•••, ) rfx + 

A=l,'*-,m; i,/=!,•••,/; 1 < «, 

(xo» J’l.'■ ■> :ym) w «« arbitrary point in the neighborhood 
of {a, bi w wholly unrestricted. 

For n = 1, P*, y*. where (Pi, • * Pm) 

Zitf5 in the neighborhood of {hi, • • •, ^m), (yi, • • •, y/) w wholly 
unrestricted. Let (q, • • •, Ci) he an arbitrary fixed point. 

Then there is an interval: 

a — /i<x<a + ^, 
and a neighborhood of the point 

(^0» ^ T in» * * * * ^/) ^1* * * *» hm^ Cj, • • • >*C/) 

within which the functions: 

r r*"’ =7*"’(*5* 0 .7l. • • •.7?n). A = 1, • • •. w; 

^ zj"’ = Z^*.’ (x ; Xo, z5, • • *, zj) y = 1, ■ • •, z, 

converge uniformly to the solution of Equations 12) : 

c Tk “ Ojt {x\ xq, y^f • • • »^^)» A — ly • • •, m j 


^^2^ = 05; (ar; 


I = ojy (ar; jTo, yl • • sjkS,, «?, • • 4)» ; = 1, • • 

Finally, the differential equations themselves may depend on 
parameters. The simplest case, 


sazf(.x,y, a) + y^ix,y, a), 
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is illustrative for the general case. Let f{x,y,aL\ a), 

slr(x,y,a) be continuous in the neighborhood of {a,b,aJ). Let 

|^=/yUr.a-) 

exist and be continuous there, also. 


Convergence Theorem. Let a sequence of successive approx¬ 
imations be defined by the formulas: 


16) 


yn =ff (*, Xn-u ») dx + Xa, 

+ Zo. 




1 < n, where (oto, yo» w an arbitrary point of a certain 

neighborhood of (a, c,a'); here, c is an arbitrary constant, 
iVhen /I — 1, the arguments yn^\> Zn^\ shall be replaced by p, y, 
where p lies in the neighborhood of b, and y is an arbitrary 
constant. Then there is an interval: 


a — h<.x<^a^rh, 

and a neighborhood of the point (xq, ^o» **•) — (^» within 

which the functions 

Xn — Xn{xi * 0 , Xtt^ *0.«). = z„ (x; Xq, ^o. «o- «•) 

converge imiforndy for n — oo to the solution of Equations 15) 

(Y = tp{x\ Xo,:ro.2o.a). 

17) ] 

'> Z = N(f (x; Xo, Xo> «•)• 


§5. Dependence on Parameters. 

plest case, 


1 ) 



Beginning with the siin* 


we have the solution: 

2 ) 


y = q>{x-, Xo,ro). 
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where is continuous in the neighborhood of (a; a^b\ 

and where 2) holds uniformly for an interval 
3) — A<ar-<tf + A* 

A being constant for points (:r0, ^o) lyhig in a certain neighborhood of 
the point (a, A). 

So much can be inferred directly from the proof of exist^ce by 
suooessive approximations. That process did not throw light, however, 
on the existence of the derivatives 


££ ISL 

dxo ’ dxo ‘ 

By means of the results of § 4 the existence and continuity of these 
derivatives can be established under no additional hypotheses concerning 
y (^* y) beyond those of § 2, Theorem. 

Start with the sequence of successive approximations: 


4) Xn—J* fix,y„-i)dx + xo- 

*0 

Then 

5) Xn = ipn(x;xo,Xo) 

admits oontkiuous Hist partial doivatives with respect to Xp, Xo' 
wish to show that the limiting function: 


6 ) r= limxn=xo + (n — yo) + (rs - n) + • • •. 

noao 


admits continuous first partial derivatives with respect to x^^yQ. This 
will be the case if the conditions of the Theorem of Chap. V, § 9 are 
fulfilled, llie one ^outstanding hypothesis is that of unifonti conver¬ 
gence of the series of derivatives: 



iZiL + V 


That this hypothesis is in fact fulfilled, can be shown as follows. 

Suppose for the mommt that these derivatives do exist, and write 
them: 


8) 

Now 
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Hoice 


9) 


X 

r=J fix,Y)dx + y^ 

l£ ~ 








9n J dyo 

*0 


From the foregoing reasoning we infer the following: — A neces¬ 
sary condition for the existence of the function 2) and its partial deriva¬ 
tives 8) is that these functions satisfy the system of simultaneous 
semi-linear differ^tial equations : 


10 ) 


^=zfy{x,y). 


du 

dx 


- w/rU.r). 


with the initial conditions: 

11) or = Xo, y = jTo. ^0 == -/Uo» Jo). = 1- 

The form of this result, combined with the developments of § 4, 
suggests a means of establishing the uniform convergence of the 
series 7) and thus completing our proof. By §4 the system 10) can 
be solved by the aid of the successive approximations: 


12) 


X 

yn =J* /(x,r«-i) dx + yo, 

*0 

X 

^—J /r(*• yx-i) Uchro). 

-*0 

X 

Ud tin-ify {.X,yn-i)dx + 1, 
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1 < n. When n = 1, the definition of yi, Zi, Ui can be made to 
serve the application we are about to consider. 

Turning to Equation 4) we see that 
^ * 

13) ' 


When n = 1, these equations become: 

g 

~ f(^0y yo)^ ^ S 

*0 

Returning to Equations 12) let us agree that, when n = 1, the 
arguments yn^u “n-i shall be set equal to ^o» 1 respec¬ 

tively. Then, by virtue of 14): 

=//(x. r,) dx + Jo. z, - 1^, «1 = 1^. 

^0 

We now subtract Equations 12) from Equations 13): 

^ - z„ =JfAx, yn-x) [ - z„_i ] dx, 

15) 

■ “" = J 

1 < 71. Hence it appears that identically, for all such values of n; 


^yn _ 


dxti 


Zm 


dyo 


and thus the uniform convergence of the series 7) is established. 

The extension of the result to the case that the differential equation 
depends on parameters presents no difficulty, and we are thus led to the 
general theorem: — 
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Tkt:obsm. Consider the system of differential equations: 

* * * ’ ^1* * * * ’ ^wi)* 

ife = I, • • •, n, where fk together with the first partial derwativesi 

dfk dj^ 

dyj^ 3Xa’ 

is continuous in the neighborhood of the point (a, • • •, hn^ 


X(, •••fXJJ,). Then the solution: 




,y%\ ^ 1 . 

* * *» Xm)» 

where 




'>yni ^ 1 ' 

• * t Xm)» 


is continuous together with aZZ n + m + 2 first partial derivatives^ 
in the neighborhood of the point {a\ a,bi^ • • • ^bn\ X^). 

Since 

“*/*(■*’? V’i» * * *♦ ^n\ X|, • • Xm)» 

it is clear that each of the derivatives 

d dip\ d diPk 

dy^ dx ’ ^Xa dx 

exists and is continuous. 


§6. Implicit Intes^ral Relations. The differential equation 
of §2 : 


dy 

dx 


=f{x,y). 


admits the solution: 

I) r = 

where tp is continuous together with its derivatives of the first order 
m the neighborhood of the point (a, a, b). It might seem, then, that 
we had found in 1) a primitive (-= solution) of the diffeiential equa¬ 
tion which depends on two arbitrary constants, Xq and y^. But in 
substance there is only one; for if we hold xq fast, we obtain the 
whole family by allowing y^ alone to vary. If, then, we write, as 
in §2, Ex. 1, the solution in the form: 
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2) x = y>{x,b), 

we have what may be called the “general” solution, depending on a 
single arbitrary constant. 

In fact, it is through the present existence theorems that one can 
attach a precise meaning to the term general solution. The for¬ 
malism of special differential equations, integrated by special devices, 
is a morass of half-true theorems, which are unreliable in any given 
case. Take, for example, the differential equation : 



The function 

is a solution of the form 

y = f{x,c ); 

i.e. containing an arbitrary constant — and that is all that is called 
for in many of the books on elementary differential equations, such 
as are used in a sophomore or junior course. But this solution is not 
general, for there is no value of c which gives the solution 


r = 0. 


On the other hand, the solution 


is general. But how is one to know, from the formalism of ele¬ 
mentary functions, even now, whether all solutions have been rounded 
up? In this case, the existence theorem of § 2 is unnecessary, as 
the explicit function supplies the demand; but the uniqueness theorem 
is essential, and answers the question with which formalism is power¬ 
less to deal. 

The example of § 1: 

?=V*. 

ax 

y — f U, a.) = (x — 0.)*, 

is also a case in point. 
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Implicit Form of the Integral, Consider the solution 1) of 
this paragraph. Let be any point on this curve, in a 

suitable neighborhood of Then 

yi =<p(*i;a^o.ro)- 

On the other hand, apply the existence theorem to the given 
differential equation 1) of § 2, considered for the neighborhood of 
(xi, yi). Then the solution is given by the equation : 

y — 

where ip is the same function as before. In particular, this curve 
goes through the point (xq, yo) because of the theorem of § 3, Ex. 1 
and the uniqueness theorem : 

yo = f Uo; 

But (xi, yi) was any point on the curve 1). Hence 

y = if {x-, Xfl, yo) and yt> — <P y) 
are equivalent equations. 

The result can be extended at once to the general case of § 3. 
Ijet the solution 2) be written in the form: 

5) y* = y*U;afo.ji. •••.rS). * = i, •••,«. 

If xq = a is held fast and y% = bj^ is regarded as a parameter, then 

4) = A:=l, 

is the general solution^ in that it gives every solution which courses 
the neighborhood of the point (xotjyJ, • • •iJX'S). The solution depends 
on n arbitrary constants, the " ^^bn- 

On the other hand, the points • • •, suod (x, jyi, • • -.yn) 

can be interchanged as above, and we have as the equivalent of 3) 
the n implicit equations: 


5 ) 


yi = f*(aro; x,yi, • • - .yi.). 


A = 1, •• ,71. 
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Observe that the Jacobian of these n functions: 


-.ipn 


lias the value 1 in the point x = Xq^ yjt = y% For, in 3), re¬ 

duces to y% when x = Xq, That the derivatives involved exist and 
are continuous, has been shown in § 5. 

A more general definition of an integral of the given system of 
differential equations is the following. Let 


c 3 •••.yn) ¥ const. 

be continuous, together with its first derivatives, in the neighborhood 
of the point (^ 0 , 71 , • • '.yn)* s^nd let it be constant along a solution 

4): 

Then the equation 

to(ar.:ri, ^ 

is said to be an integral of the system of differential equations. 

If 


are two integrals, they are said to be independent if the matrix 


1 a®, , 

... 

dyi 

SXn 


. . a ®2 

djTi 



is of rank 2 . — The generalization of the definition to the aise of k 
integrals is obvious. 



Ck = CO* (i>j, • •jhn), A - 1, • * •, 7 ?, 

where o>* (^ 1 , • • •,^) is continuous, together with its derivatives of the 
first order, throughout the neighborhood of the point (^|, * * *»^n) 
W* * • ’.yS), and the Jacobian 
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Let 


^ (^1 » * * * t Cn) 
d (^2, • • *,^fi) 


7 ^ 0 . 


Vk (^; U;q. *•*c„), 

Show that the equations 


k = 1 , • • •, 71. 


== 'I'aU; Cu * • A: = 1, • • 72» 


express the general solution of the given system of differential equations 
1)» § 5, — in the two-fold sense in which that term has been ex¬ 

plained. 

State 3 rour final result accurately as an independent theore n. 


§7. Linear Differential Equations. Tui:orfm 1. Consider 
the system of linear differential equations of the first order: 


1 ) 


dYk 

dx 


= ^lky\ d-“b J^fikyn + Pk^ 


A* = 1, • • 71, where Pjk = Pjk (^) ^k = ^k (•^) continuous 

in a closed interval: 

2) a ^ X ^ b. 

Let ij, ‘ • \ bn be an arbitrary set of numbers^ and let Xq be 
an arbitrary point of 2). Then there exists a solution of \): 

3) rA = fAU)» A=l, --STI, 

where (x) is continuous, together with its first derivative, in the 
closed interval 2) and 


Vk^^a) = A = 1 , • • -,71. 


Moreover, the solution is unique. 


The theorem comes under the more general one of § 3, Exercise 
4. By means of this theorem it is jiossible to treat the linear 
differential equation of the /i-th order: 


4) 


d^y 

dxT 


+ Pi 


dr-^y 

dx^'-^ 


+ • 


+ Pny^p. 


where the coefficients pk~ Pki^) and ;t 7 = p(x) are continuous in a 
closed interval 
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5) 

For on setting 

6 ) 

we have: 


a X b. 

^yk _ ^ 
dx -^*+1’ 


7) 


dy _ 


dx 


= J'l. 


= r, 

dx 


Ayv-n 

dx 


= yn-\. 


Ayn -1 _ _ 
dx 


Pi r/1-1 - • “ —pny + p^ 


We are thus led to the following existence theorem. 

Tiii:ori:m. 2. The linear differential equation of the n-th ordt r 
Equation 4), admits a solution defined throughout the interval 5); 

y-vix), a ^ X s b, 

such that, if Cq, Cj, • • •, c„_i be any n numbers whatever, 

ip (xo') = Co, if (*o) = Cl, • • •, (xo) = C„_i. 

The solution is unique. 


§8. Differential Equations of Higher Order; General 
Case. The general dift'er^tial equation of the n-th order can be 
written in the form: 


1 ) 


dFv 


dx" 




dy 

dx 


dsd‘-'^ J ’ 


where fi^sXs Xu * ‘ ^ n-i) is continuous, together with its first deriva¬ 
tives with respect to y.yu "'syn^u neighborhood of a point 

(^Tq, Vq, • • •sjKn-i)* On making the substitution 6) of §7, the 
given differential equation 1) is replaced by the system 7) of § 7, except 
that the last equation 7) now becomes: 


2) 


=‘f^x,y,yi, • • ■,yn-i)- 
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The existence theorem is precisely similar to Theorem 2, §7, 
except that the domain of definition of the solution is restricted to 
the neighborhood of the point x = Xq. 

Exercises 

1. Extend the existence theorem to the most general case. 
Begin with two differential equations : 


= /(^. r. y. • • . 


d^z 

dx'" 


= ■ • - .y""*-’, r, z’. 


2. Apply the result to the system : 
cPqjc 


dt^ 


nlqk — 0, 


^ = 1 , 




where n* is a positive constant. 


§ 9. Complex Variables* C-orresponding theorems hold in 
the domain of complex variables, but the proofs are simpler. Be¬ 
ginning with the simplest case, 

& 

let f{x^y) be a function of the two complex variables x and jy, ana¬ 
lytic in the point (:co»^o)- Then there exists a solution, 

j = ^ {x\ 

analytic in the point x = Xq and taking on the value jyo there: 

rc = y (^o)- 

Moreover, this solution is unique. 

The proof can be given by the method of successive approxima¬ 
tions, as before; but the details are simpler. For when once the 
series 

* + (- 7o) + Ira - ri) + • • • 

has been shown to be uniformly convergent throughout a certain 
two-dimensional, or complex^ neighborhood of the point x = Xo» it 
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follows that the series represents an analytic function and can, by a 
general theorem due to Weierstrass, be differentiated term-by-term. 
Moreover, thf case that f depends on a parameter, a, the function 
of the three complex vaiiables being analytic in the point 
(xq, jyo' Is dealt with immediately, without any additional analysis. 
The function ^ (x, a) of the complex variables is analytic in the 
point (xo, ao)i ^tnd so can be differentiated with respect to a an un¬ 
limited number of times, the series being differentiable term-by-term. 

The genet-alization to the case of a simultaneous system of n 
differential equations presents no difficulty. 


§10. Linear Partial Differential Equations of the First 
Order. Consider the linear partial differential equation: 


A) 


+ ••• + X„-pL = o, 

OXi dXn 


where Jf* = yA(xi, • • •,Xu) is continuous, together with its first 
derivatives, in the neighborhood of a point (a^, ***,^ 11 )* and not all 
the A'* vanish there. 

Consider, secondly, the simultaneous system of total differential 
equations: 


B) 



dx„ 

An 


To solve Equation is equivalent to solving equations B)\ and 
conversely. 

The theorem is adequately illustrated in the case n = 3 : 




xii+r 

OX oy 


+ z 


dz 


= 0 ; 


B') 


dx _ dy _ dz 
X Y ~ Z 


The solution of B') is given by the equations: 

1) r =/(*} *o.J"o. 2 o). z (x; Xo,7o.Zo). 

provided X{a,byC) ^ 0, where (xq, ^o»^o) H®* the neighborhood 
of (a, ^,c). Let x^ ~ a be held fast, and interpret (/o*^) ^ point 

in the plane x = a, lying near {y^ z) = (ft, c). Then the equations 
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2) r =/ (^5 ro» ^o). Z —Ip {x; a, 2o) 

represent a two*paranieter family (a so-called congruence) of curves 
coursing the neighborhood of (a,h,c). No two of these curves in¬ 
tersect,. for then there would be two solutions of B') through such a 
point. Moreover, through each point of the neighborhood passes a 
curve 2). For, the implicit form of 1) is 

5) ro ^0 = 9 (-^o; ^)- 

Hence 2) is equivalent to 

4*) ro = /(«; 2 ). ip {a\x, y, z). 

We see, then, that an arbitrary point (jti, Zj) near (a, c) will lead 
through 4) to a point [y^, Zq) in the plane x a, near {b, c); and the 
curve 2) corresponding to these values of yo, Zq will go through 
rii «i)- 

Integral Surfaces, Consider the surface: 

5) f {a \ X, y, z) = const. (~ jo)- 

It cuts the plane x = in the line y •=. y^^ •=, cx)nst. For, 

6) /(^o; ^oi^ot^o) ^ ro 
is an identity in (xq, jy'oi ^o)* Hence 

/(«; a,y,z) ss y, 

no matter how {y, z) be chosen near (fr, c). Because of 5), y must 
have the value y^x but z is arbitraiy. 

The equation 5): 

/(a; x,y,z) = j', 

can be solved for y\ for 

¥\ 

Hence 5) can be represraited in the form : 

7) y = ^ (^. z). 

The surface 3) is an integral surface of the differential equations 
B% as has already been pointed out in § 6. In particular, then, the 
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solution of jB') which passes through a point (xi,ri,z)of 5), cuts the 
plane ar = u in the line y = y^. Thus the surface 5) or 7) is swept 
out by the solutions of 5') which pass through the points of the line 
y ^ y(^ m the plane a: = «, near z = c. 

Similar remarks apply to the surface 

8) ^ {a, X, y, z) = const. (= ^o)- 

This surface cuts the plane a = a in the line z = zq = const. Equa¬ 
tion 8) can be solved for z: 

9 ) z--{x,y). 

This surface is swept out by the solutions of which pass through 
pcnnts of the line z = Zq in the plane x = a, near y =b. 

Consider now more generally an arbitrary i-egular curve of the 
plane x = a, which passes through {y^ z) = c): 

10) O (yo, zq) = 0, 

where the first derivatives, 0^ and Qo, exist and are continuous near 
(ft, c), and not both vanish there. The equation 

11) Q(/>f) = o 

represents a surface, swept out by the solutions of B') which cut the 
plane x = a in a. point (yQ, Zq) of the curve 10). For the points that 
lie on these solutions obviously are points of 11); and conversely, a 
point Zi) of 11) near (a, c) determines a pair of values • 

n =/(«; Xu «i). zo = («; ari.ri.«i) 

which satisfy 10). 

Solution of the Partial Differential Equation A'), The function 

12 ) u—f{a,x^y,z) 

is a solution of A^), For, the nonnal to the surface 5) in an arbi¬ 
trary point is perpendicular to the solution of B^) through this point. 
Hence 
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Similarly, the function 


u = ^{ai x,y,z) 
is a solution of A') and we have 


U) 


x^+ yi2 + = 

OX oy dz 


More generally, 

15) m = Q(/,^) 

is a solution. For 






du 

dy 


= Qi 




+ o,|£. 

ay 


\ 


d u 
dz 


=.-0j 


2f 

dz 


+ Oo 


dip 

dz 


On multiplying by X, F, Z respectively and adding, the result follows 
froui 15) and 14). 

Finally, let 

16) u — ^{x,y,z) 


be an arbitrary solution of A^)y where 'If is continuous together with 
its first partial derivatives in the neighborhood of the point («, c) 
and not all the derivatives vanish there. The surface 


17) 


^ {Xy 7, Z) = Sk (fl, by C) 


is tangent at an arbitrary one of its points to the solution of B^) which 
passes through this point, as is clear from A*). In particular, then, 
the surface is not tangent to the plane x = 

Moreover, the solution of B') which goes through a point of 17), 
lies wholly in the surface. For, when y and z are given by 1), 


dx 


= + 'Ifj. 


r 

X 



= 0 . 


It follow's, then, that the surface 17) is svi'ept out by the solutions 
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of B') which pass through the intersection of the surface 17) witli 
the plane a. 

There is still one point to be considered. The surface 17) cuts 
the plane ^ « in a curve 10), for since this surface is not tangent 

to the plane it follows that not both the derivatives dAl/dy 

and d^/dz can vanish. The surface 17), therefore, is swept out by 
those solutions of B') which pass through the points of this curve. 
The converse, however, requires proof, for it is not evident that the 
solutions of B') which pass through the points of 10) sweep out a 
surface 17)« Let 

o (/.ip) = ■F’U.r**)* 

where O(yo»^o) any function 10). Then we will show that Fr. 
Fz aie not both 0. We have: 

Fr = Q| ^ + 0, 


Now, 


If-- 


giAg) 


9^ 


0 , 


and Oi, O 2 are not both 0. Hence Fy, Fz cannot vanish simultane¬ 
ously, q. e. d. 

The result may be stated in a somewhat more general form as 
follow's. 

Soi.UTlON OF A') BY B'). Let V be a regular curve drawn 
through the point {a, b, c), not tangent to the solution of B') there. 
The solutions of B') which pass through the points of T sweep 
out a surface^ 

20) ♦(ar,j-,z) = C, 


where ^ is continuous together with its first partial derivatives in 
the neighborhood of (a, b, c), and not all of the latter vanish. The 
function 

21 ) u--=^{x,y,z) 

is a solution of A'). And conversely^ any solution 21) q/* A% such 
that ^ satisfies the above conditions of continuity^ is obtainable in 
this manner. 
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Solution of the Total Differential Equations B^). We proceed 
now to solve the system of total differential equations B*) by means 
of the single partial differential equation A^). Let 

22) li = ♦ {x, y, z), M = 0 {x, y, z) 

be two solutions of A^) such that the rank of the matrix 


a* 

dif 


dx 

dy 

dz 

1® 

de 


dx 

dy 

dz 


in the point {a, b, c) is 2. Then the curve 

24) ^ (x, y, z) = a, 0 (x, y, z) = 

where (a, P) is a point of the neighborhood of (ao, Po) • 

* {a, b, c) = ao, 0 {a, b, c) = Po, 

is a solution of B^). For each of the surfaces 24) contains the solution 
of B^) which passes through a point of intersection of these surfaces. — 
We may state the result as follows. 

Solution of 5') by A^), Let ^ (x, y, z) and 0 (x, y, z) he 
two solutions of A^) satisfying the conditions that the matrix 23) is 
of rank 2. Then the solutions of B') are given by the equations 24). 

§11. The General Case. It is now easy to state the theorem 
in the general case. Given the linear partial differential equation A) 
of § 10 and the system of n total differential equations B\ let at least 
one Xk be different from 0; 

(^1* • • •* ^n) 7^ 0. 

Through each point (x®) = (x?, • •, x®) of the neighborhood of {a) 
passes one and only one solution of B\ represented by the equations 

X? = ipi{ai\ Xi, • --.Xn), £ = 2, • • •,/!; 

^ Q 

3 (xa, • • ■,Xn) ^ 
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In particular^ there is a one-to-one relation between these solutions 
and the points • • *,^5) in which th^ cut the plane Xi = aj. 

Each function 

U =: Xi, •• -.Xn) 

is a solution of A)» More generally, let 

0 

be continuous, together with its first derivatives, at least one of 
which shall not vanish in (fl 2 » * ‘ * ^n), and let 

0 • • •, an) = 0 . 

Then the function 

n = O (^2» •• sfk) 

is also a solution of A). It is, moreover, the most general solution, 
u — Slf (xi, •••,Xn), 

which has the property that at least one first derivative (here, 
du/dxi) does not vanish. Thus A) is completely solved by B). 
Conversely, B) is completely solved by n — 1 solutions of A ); 

U — (X|, • • •, x„), • • *, (xi, • • •, x„), 

considered in the neighborhood of the point (x) = (a), provided that 
the rank of the matrix 

. 

dxi dxn 

«••••••• 

. 1 

dxn 

in the point (a) is n — 1. The n — 1 equations: 

(xi, • • •, Xw) = C„ i = 2, • • •, n. 


detennine the solutions of B)- 
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§12. Change of Variables. Let 


1) 




k — 


where nr*(xi, • • •, *») has continuous first derivatives in the neigh 
borhood of the point {x) = (a) and 


2) 


d(xu---,T„) ^ ^ 


in (x) = (a). Then A) and B) go over into 


Zi 


du 

^y\ 


+ • 


+ z„ 



= 0 . 


Let 


i2i= ... =: 

Zi z„ • 




k— 1 , 


where ft is any non-vanishing function of [xi, • • •, Xn), continuous 
together with its first derivatives near (a). Then the solutions of A) 
and B) will go over into the solutions of 


d u 

^y\ 


+ 


du 

dyn 


= 0 ; 


dyi = ... 

Fi y„ • 

It appears, then, that the equations A) and B) are invariant of 
a transformation 1). We can use this fact to reduce them to a 
simpler system, in case one or more integrals are known. Suppose 
that m <. n independent integrals are known. 


(^1. ♦mUi, • • •, T„), 

where the matrix 




dxi 

dx„ 



dxi 

dx„ 


5 ) 
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is of rank m in the point a„). Make a change of variables, 

setting (in case the detenninant corresponding to the first m colmnns 
of the matrix is ^ 0) 

4) JTk — •-.Xn), 

with the further ^’s any functions such that 2) is satisfied. The 
transformed equations admit the integrals 


and hence 


yu **sr»«* 


ri = o, •••, Ym^O. 


The transformed system thus takes the form, if m < n — 1: 


6 ) 


[ 


Tm+i *5- + • • • 4* Yn *3- 

Oyn 

^yrn+l _ . . . _ dXn 
Tm+l Yn ‘ 


These equations can be solved by setting 


6) Xk — Ck, A = 1, • • sm, 

where the Ck are suitably restricted arbitrary constants, and then 
considering the new system. We have thus been led to a system of 
equations like the original system, the number of variables, however, 
having been reduced from n to n — m. 

Transforming back to the original equations in the ar’s, i.e. to 
Equations A) and jB), we see that Xj, • • •, Xm can be determined 
from the equations 

7) (xj, • * *, X/i) — C\y * * ** (X|. * * *, Xb) “““Cm* 


Thus the equations 

8 ) 


dxm^y _ 
A'm+i 


dXn 

Xn 


yield, on replacing Xi, • • •, Xm in the by their values from 7), a 
system in which only n -- m variables, Xm+f, • • •»Xn appear. 

The justification for the elimination in both cases lies in the 
theorem of uniqueness. One solution of Equations 5) is given by 6) 
and the n ^ m further equations. But there is only one solution. 
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One question, however, still remains open. We started with the 
hypothesis that at least one of the X’s did not vanish in the point 
Are we sure that there will be a T which will not 
vanish? Otherwise we could not apply the existence theorem to 
Equations 5). From 4) we have: 

^7* + . . . 4- CnkdXn, A: = 1, • • 71, 

where the determinant of these equations is the Jacobian 2). From 

dxx _ _ dxn 

Xx ' Xn 

follows that each of these ratios has the value: 


C]kdX] 4 “ • * • CnkdXfi 

Ai 4“ * * * 4" Cnk Xn 

Hence these denominators cannot all vanish, and so, in particular, at 
least one ot the Tot+ii F/i must be different from 0. 

§13. The General Partial Differential Equation of the 
First Order; /i = 2, ( Consider the partial differential equation 


1) 

where 

2 ) 


F (x, y, z, p, q) = 0, 



7 = 


dz 
By ' 


Here, F {x, y, z, <7), together with its partial derivatives of the 
first two orders, sh<ill be continuous in a region of the space of the 
{x^ y\z,p,q\ where {x,y,z) is any point of a region R which 
includes none of its lioundary points, and p, q are wholly imrestricted*. 
Finally, BF/dp and dF/dq shall not vanish simult .ously. 

What does the differential equation 1) mean geometrically? VVe 
seek an answer analogous to that given in § 1 tor ordinary differential 
equations. 

liCt Uoi J o» *2^0) 1 ^® ^ point of il, and let 


3) 


z = $ (x% y) 


* More generally, we may impose the requirement for the neighborhood 
of a point (a, b, c, «, 3). The treatment is essentially the same. 
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be a solution of 1), the surface S represented by 3) passing through 
(*^ 0 * yot ^o) ts assumed that ® (:r, y), together with its first 
derivatives, is continuous in the neighborhood of (xq^ ^q). The direc¬ 
tion components of the normal to 5 are {po, ^o* — l)f where 

Po — (a^o. ^o). Uo. yo)- 

Th<*y are subject to the condition: 

♦) F(xo, yof * 0 . Po> 9o) = 0. 

This fact gives us the clue to the geometric interpretation of 1) 
which we are looking for. Let (^, z) be an arbitrary point of /{, 
and hold it fast. Then 1) defines a one-parameter family of lines 
through (xt y, z), namely, those whose direction-components are 
(Pt ““ 1); and these lines generate a cone, JV, — the cone of normals 
to the solutions of 1) which pass through (x, y, z). 

The planes through (:r, y^ z) normal to these lines envelop* a 
cone T. These planes are the tangent planes to the solutions of 1) 
which pass through (or, y, z), and each generator of the cone lies in 
one of these planes. We thus have, assigned to each point of R, a 
cone T, and any solution of 1) defines a surface in R which is 
tangent at each of its points to the cone corresponding to this point. 

This is hardly enough, however, to enable us to determine the 
integral surfaces S of 1). But we can go a step further. Turn 
back to the point (xo, consider the tangent planes per¬ 

taining to this point. They are given by the equation 

5) z- zo = p{x- xo) + q{y- yo), 
where /?, q are parameters connected by the equation: 

6) F (xo, yo, zo, p, q) = 0. 

Their envelope is determined by 5) and the further equation : 

7) 0 = (x — jpq) + 0^ J^o)» 

dq 

in case dF/dp ^ 0, the condition mentioned in the foot-note being 
fulfilled. Introduce the notation: 

* A further condition of inequality here is needed; cf. the Author’s 
Advanud Calculus^ p. 194 and p. 564. 
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8) X = 


dF v_aF ^_dF 

1-—, Z ^~dq' 


dx' ^ dy' 
Then 7) is equivalent to 
9) 


X - jQ _ y — yt > 

P Q ■ 

We now have new geometrical data relating to the surface 3). 
It not only is tangent to the cone T in {xq, yo, Zq), but we can assign 
a tangent line to 5 in this point, namely, that generator of T which 
is tangent to S, Thus to each point of S is assigned a direction 
lying in the surface and having the direction components dx^dy^dz 
satisfying the relations : 


10 ) 


dx _ dy _ dz 
P pP + gQ ' 


More precisely, we think of a curve drawn through Cro,jyo»^o) 
surface 5: 

11) X =/(X), y — v (X), z = f (X), 

ha'^dng in (s?,, yo, Zq) direction componoits given by the equations: 


12 ) 




dz 

dk 


= ;?P + 7Q. 


We see, then, that the surface S is swept out .by a one-parameter 
family of such curves. They are determined through the existence 
theorem of § 3 (including, in particular, the property of uniqueness) 
by the system of differential equations: 


dy dz _ pP + gQ 

dx P^ dx P 


in case P 9^ 0; otherwise by 

^ dz_pP + gQ 

dy Q' dy Q ' 

where p, g are giv«i by 3). 

Let us follow one of these curves along the surface 5. The curve 
can be represented by Equations 11), thought of as an integral of 
12), p and g being obtained from 3). Now, turn to Equation 1). 
This becomes an identity in x and y when we substitute for p, g 
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their values from 3) and 2). Hence the partial derivatives with 
respect to x and y vanish identically, or 


13) 


r + ,z + P^ + e^ = o 


14 ) 


On the other hand, along the curve 11), we have from l'_*): 


As-- h-A se- A. h-= pAz. 

d\ dx d\ dy dX dx 

Ai,^4jlA£..Az.A^ = p1r. 

dk dx dk dy dk dy 


+ Q 


djL 

dx 



Hence 


15) —-X — p Z, -— F — <7 Z. 


We may write the final result in the form: 

^ dy _ dz ^ dp dq 

' ^ i> y pidArciil X-^pZ Y ^qZ ' 

These equations, irrespective of any particular integral surface 
5 ), and also irrespective of the condition of inequality, foot-note, 
p. 388, define a four-parameter family of curves in the five-dirnensional 
space of the variables {x^y^z^p^q). Since P and Q are not both 0 
in the point Ai (a, Z?, c, a, P), let P ^ 0 there. The primitive of 
16) can then be written in the form : 

' y-fi <7o) 

^ ^ ^ f 2 ^ 0 » .Fo» ^ 0 * PO"* 7o) 

1 P-fzix^ xq, yo, Zq, Pq, qo) 

\ ^ ~*/4 '^0» Xo» ^0* P'\^ 7o) 

Each function fj^ admits a continuous first partial derivative with 
respect to each of the six arguments, x \xq, • • • \ § 5. The partial 
derivative dfi/dx is the same as the total de»*ivative dy/dv in 
16), or 

dfx _ dy _Q. 
dx dx P ' 


18) 



DIFFERENTIAL EQUATIONS. EXISTENCE THEOREMS 391 


and similarly for each of the other df^/dx. Moreover, the order of 
differentiation between x and any one of the arguments jtq, jko» 
always be reversed, § 5: 

d dy __ 

5 Vy dx dx dvQ ’ 


19) 


etc. 


The Curves C. The four-parameter family of curves 17) shall 
be denoted as the Curves C. They sweep out the neighborhood of 
the point J just once. Without loss of generality vv-^e can set .tq = a, 
and then jyy, Zq, po, represent the four independent parameters of 

the family, the equations now taking the form: 


20 ) 


r =/i ro- zo. po, go) 

z =/, (j: ; a, Jo, Zo, Po, <7o) 
P—foix-, a, Jo, Zo, 7>o, 7o) 
g-fi[x-, a, Jo, Zo, Pas <7o) 


Along any one of the curves C the function F is constant: 


21 ) 


F (x, j, z, p, q) = C, 


as appears at once fro.n 16): 


22 ) 


dF 

dx 


X + Y 


dy 

dx 


+ Z + P 

dx dx 


+ Q 


dq _ 
dx 


0 . 


Thus we have in 21) an integral of the simultaneous system of total 
differential equations 16). 

From the foregoing analysis and the theorem of uniqueness we 
Cnin inter the following theorem. 

Tiir OR! M 1. Let (ry, yo, po, q^) be a point of the neighbor¬ 
hood of such that 

Fixa, Jo, Zo, Pa, go) = 0 - 
Let 

23) 2 (x, y) 

be an integral of the partial differential equation 1), where ^ (jr, y) 
is continuous^ together with its first derivativesy in the neighborhood 
of {xy y) = {xQy jyo)» where, furthermore. 


♦ Uo. .n) = ^0. ro) = (^0. yo) = ^0- 
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Then the curve defined by the first two equations 17) lies wholly 
in the surface represented by 23), and at each point of this curve 

u. y) = p, U y) —9 

where q are given hy the last two equations 17). 

Parametric Form, The curves C can be represented in par¬ 
ametric form as follows. Replace 16) by the extended system: 


24) 


dx _ dy _ dz ^ ^ dp dq 

P Q pP^qQ X^pZ Y + qZ 


du 


where G = G (j:, y^ z, p^ q^ u) is continuous, together with its second 
derivatives, in the neighborhood of the point (a, ft, c, a, jS, 0) and 
does not vanish there. If, in particular, G = 1, then u is usually 
represented by t: 


du 

G 


= dt. 


Or, again, we may set G ^ P^ when P ^ 0, and then m = x. and 
we fall back on the integral in the form 17) or 20). 

In the general case we have as the integral of 24): 


25) 


' x — f I («; Xo, yo, Zo. Po> 9o) 
y = fz (u; xo, yo, Zq, po, 90) 
< z—ipi{u-,xo, ro. «o. 9a) 

p = 9>i (u; Xo. yo, zo, Po, 9o) 
, 9 = 9b * 0 . yo, * 0 . Po, 9o) 


These equations, for values of u near 0, represent the curves C. 

Characteristics, The curves C form the basis for the d<^finition 
of the characteristics of the partial differential equation 1). Some¬ 
times these curves themselves are called characteristics. More narrowly, 
it is the curves C for which 


26) F (xo, 2o. Po, 9o) — 0 

that have especial importance for the integration of 1). The first two 
of equations 17) or the first three of equations 25) define a curve in 
the (x, jy, z)-spaoe and assign to each point of this curve a tangent 
plane, the direction components of whose normal, {p^ </, — 1), are given 
by the last two equations. Such a curve and the tangent planes as- 
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sociated with its points are called a characteristic strip, A characteristic 
strip is said to lie in a surface if the curve lies in the surface and 
each associated plane is tangent to the surface. 

In the foregoing developments is contained the proof of the 
following theorem. 

TfiKOBKM 2, Ij S is the surface corresponding to a solution 
of 1) and if the curve of a characteristic strip meets S in a point 
O, the associated plane at O being tangent to 5, then the whole 
characteristic strip lies in S, 

It is understood that S is a regular surface such as is given 
by 23). 

There is a three-parameter family of characteristic strios, and 
it can be represented by 20), subject to the condition 

27) F («, ^ 0 . ^0- /’o. 9o) = 0. 

The curves of these strips, represented by the first two equations 20), 
cotnbined with 27), course the neighborhood ol the point (x, jy, z) 
= (tf, b^ c) and carry with them their tangent planes. The proble n 
of integrating 1) is to fit into this neighborhood, in all possible 
ways, surfaces which coincide at each point with a characteristic 
strip. We turn now to the solution of this problem. 

§14. Continuation. Integration by Means of Charac¬ 
teristics. Let a curve 

28) Zo = ® (j^o) 

be drawn in the plane x ^ a. Here, o (j^) shall be continuous, 
together with its first and second derivatives, in the neighborhood of 
the point y =.b^ and moreover a> (^) shall =2 c : 

c = {b). 

Restrict y^ to the neighborhood of b. 

Through each point of this curve passes a curve C, defined as 
follows, yo and Zq shall be connected by 28). Furthermore, shall 
have tbe value: 
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Finally, shall be ^ven by 27). Thus appeal’s as a parameter; 
set it equal to vt 

Xo = 

These curves C sweep out a surface, defined parametrically by 
the first three equations 25), where we shall find it convenient to 
take the paiduieter ii as x, and to set Xq = a. Thus (pi ^ u and 
equations 25) reduce essentially to 20), but the exposition is clearer 
in the parametric form ; 


29) x—J iu, v), y - V {u, v\ z = ylr ( m , v). 


First of all. 


For, since :r = li, 


/ = 


^ y) ^ 

d ( m , v) 


0 . 


Next, 

and hence 



dx 

dv 


= 0 . 


<P 2 {a\ a, yoiZo, 9o) = Jo = 


= 1 when u = a. 

dv 


Thus / = 1 when u ^ a, v = h. It is, therefore, possible to solve 
the first two equations 29) for u and v. Substituting these values in 
the third equation, vs'e find: 

30 ) z=^^{x,y)y 

wdiere together with its first derivatives, is continuous in the 

neighborhood ot («,//). 


Tiu oiu.m 1. The function $ (a:,j) is a solution of the given 
partial differential equation: 


31) 


dz dz \ 


'\ he dii-ection components of the normal to the surface 30) are 
—1). VVe have to show that make the equation 

F(x,y,z, - 0 
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an identity in (.r, jy). Now, from 30), 

dz = dx -f dy^ 

no matter what the independent variables are. And conversely, if 


32) dz ^ p dx q dy\ 

no matter what tiie indej^endent variables may be, it follows that 


p — q = 

A necessary and sufficient condition for the truth of 52) is : 


33) 


du ^ du 

dz _ dx 
^ dv ^ dv 


+ q 


dy 

du 


+ 9 


dy 

dv 


'Fhe first equation is equivalent to 


dz 

dx 


q 


dy 
dx ’ 


and is true because of 16). 

To establish the second equation, write 


34) 


U («, v) — 

dz 

dv 

dx 
^ dv 

d y 
dv 


Along the 

curve 

28) 





dz _ 

dz„ 


dx _ 

_0 



dv 


— 0)i 

dv 


dv 

Syo ’ 

and hence 







35) 



U («, v) 

= 0. 




'\e will show that U {ii, v) = 0 along each curve C. 

To do this, compute dU/du along an arbitrary C. Rememlier- 
ing that, on account of 19), the order of differentiation can be 
iieversed, we have: 


36) f _ dp dx _ p _ dq dy ^ dy 

du dv dx dx dv dx dv “ dv dx 


_ d pP + qQ X + pZ dx Y qZ dy d Q 
dv P P dv P dv dv P 
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= ^{(X + pZ)^ + (T+,Z)^iP^ + Q^}. 


On the othei band 


57) 


Fix, y, z, p,q) — tS 


along any curve C and hence at every point of the surface 50); i.e. 
37) is an identity in the variables (ii, v), I^ce 


“=^ If + ^ ^ fe + p I? + <? !?■ • 


dv 


dv 


dv 


dv 


On subtracting this equation, divided by P, from 36) and re- 
niemberuig 34) we find: 


58) 



It is this equation which determines U along a curve C. Re^ 
gardingf then, t; as a parameter which characterizes C, we may write 
58) in the form: 

dU Z 


39) 


dx 


a 


We seek the solution of this differential equation which vanishes when 
X a. One such solution is £7 = 0. Because of the uniqueness 
theorem there is only one solution, and the proof is complete. 

Tur.ORFM 2. Let 

40) z — ^{x,y) 

be a solution of 1), where '^{x^y) is continuous^ together with its 
derivatives of the first order^ in the neighborhood of the point 
(a, b') and ♦ (a, V) = c. Let F he the curve in which the surface^ 
5, represented by 40) is cut by the plane .x a: 


41) 


X —a, z — ^{x, y). 


Then the characteristic strips determined as above by F sweep out 
S just once. 

For, first, a characteristic strip determined by a point of F and 
the tangent of F at that point, Hes wholly in S; § 13, Theoxem 2 
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Secondly, at an arbitrary point of 5 a characteristic strip is determined, 
which lies wholly in S. The curve of this strip cuts the plane 
jr = a, and the point of intersection is necessarily a point of V. 

This theorem is only partially a converse of Theorem 1. For 
in that theorem, the function c»(jr) was required to possess a second 
derivative. But it can happen that the curve of Theorem 2 is such 
that ^ (a, y) has no second derivative; e g. 

F{x,Y,z,p, q) —p. 

On the other hand, Theorem 1 is not true if o>(y") is required 
merely to possess a continuous first derivative, as is shown by the 
example: 

F{x,y,z,p, q)— p ^ q\ 
u 

<t> (m) = ^ /(«) du, 

<) 

f(u) = ui sin , u ^ 0; / (0) = 0- 

Here, (a^ b, c) = (0, 0, 0). 

The form which Theorem 1 should take, if it and Theorem 2 
are to be each the converse of the other, is the following: — 

Theorem t': Gii^en the partial differential equation 1 ). Let 
o) (y^) be continuous^ together with its first derivative^ in the neigh-- 
horhood of the point y =.by and let ® {b) = c. Let F be the curve*, 

X = a, z = « {y). 

Consider the characteristic strips determined by the points and 
tangents of V, If the curves of these characteristic strips sweep 
cut a surface 

z = ^(x,y% 

where ♦ (x, y) is single^valued and continuous, together with its 
sierivatives of the first order, in the neighborhood of the point (a, b), 
then ♦ {x,y) will be a solution of 1). 

d sufficient, but not a necessary, condition for the fulfillment 
of the last hypothesis is, that cs {y) possess a continous second da- 
rtvative^ 
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Uniqueness, Observe that in an)'case two solutions oF 1), which 
correspond to one and the same curve F, are identical. 

More generally, let S and S* be the surfaces correswnding to two 
solutions of 1), and let 5 and 5' be tangent to each other along a 
carve F' which nowhere touches a characteristic curve of either surface 
Then the solutions are identical. 


% §15. The Case of n Variables. Both the theoi’e.n and the 

treatment by characteristics can be extended immediately to the general 
case. Let the partial differential etpiation 


dz 




0 


1 ) 

be given, where F{x^, ■ • ■ ,x„,z,pi, • • • ,p„) is continuous, together 
with its partial derivatives of the first two orders, in the neighborhood 
of the point A : (/ij. • - a„, c, by, • • •. b„). Write 


Xk=-- 


dF 


z = 


dF 


Pk = 


dF 
dpk ' 


dxk ' dz 

I^t the Pk not •'ll vanish in the point A. 

The characteristics are defined on the hand of the 2 m equations: 

dz _ — dp)i 


2 ) 


dx^ _ 

Pk TipkPk 


A = 1, • M. 


Xk^Pkl' 

These equations determine a 2M-parameter family of curves C in the 
(2n + 1 )-dimensional space of the variables, which, in case /*j 0 

in A, can be represented in the form: 


3) 


**= 

•,x^„,z°, p\, ■ 


A = 2, • • •, n; 

il 

z®, p?. 



Pk = fn+J 4. ' 

•••,zS, z®, p?, ■ 


/=!,•• •, n. 


Here, x® can be held fast: 

4 ) a:? = a,, 


and then xS, • • •••, pi afford a system of 2n independent 

parameters. 

The characteristic curves are defined by the first n of the equa¬ 
tions 5), where the (x®, are subject to the conditions 4) and 

5) F(4 ••',4. = 
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The characteristic strips are defined by all 2/1 of the equations 
5) and are thought of as the characteristic curves, to each point of 
which is assigned a (hyper-) tangent plane, the direction-components 
of the normal being (^5, • • •, p^). 

Fihm here on the theory proceeds as in the earlier case, cul¬ 
minating in the 

Theorem. Given the partial differential equation 1) with 
Pj ^ 0 in A, Let o) (oto, • * •, Xn) be continuous^ together with its 
partial derivatives of the first order^ in the neighborhood of the 
point {a^^ * • •, tf/i) and let 

<0 (aof •• •y an) = c. 

Through each point of the manifold 

x = aiy z® = cD(xg, •• -yxH) 


pass the characteristic strip determined by the point and the tangent 
plane; i, e set 


0 


k = 2, 


•,n. 


being given by 5). 

If the corresponding set of char act erUtic curves y determined 
by the first n equations 3), sweep out a surf ace y 


Z = *(xi, ••S.Tn), 


where is single-valued andy together with its partial 

derivatives of the first order, continuous in the neighborhood of 
{ttiy * * *, Ur^y then ^{x^y • • *yXn) is a solution of 1). 

A sufficienty but not a necessaryy condition for the fulfillment 
of this last hypothesis isy that oo(xj, • • •,oT/i) admit continuous 
derivatives of the second order. 

Converselyy any solution of \) satisfying the conditions im¬ 
posed on $ (:ri, • • •, Xn) defines a surface which is swept out by 
characteristic curves as above. 


Uniqueness, The earlier theorem of uniqueness for tlie case 
;/ = 2 admits of direct generalization to the case n = n. 





